-- Logs begin at Wed 2022-08-17 06:45:17 UTC, end at Wed 2022-08-17 07:45:45 UTC. -- Aug 17 07:13:01.282751 dv-cinder-853126-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 07:13:01.294337 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 07:13:01 2022] *** Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: nodename: dv-cinder-853126-2-iscsi Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: machine: x86_64 Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: clock source: unix Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: pcre jit disabled Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: detected number of CPU cores: 4 Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: current working directory: / Aug 17 07:13:01.294940 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: detected binary path: /usr/bin/uwsgi-core Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: your processes number limit is 47680 Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: your memory page size is 4096 bytes Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: detected max file descriptor number: 2048 Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: lock engine: pthread robust mutexes Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: thunder lock: enabled Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 07:13:01.295583 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 07:13:01.333775 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: Python main interpreter initialized at 0x5640f1e209c0 Aug 17 07:13:01.333775 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: python threads support enabled Aug 17 07:13:01.333775 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: your server socket listen backlog is limited to 100 connections Aug 17 07:13:01.333775 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: your mercy for graceful operations on workers is 90 seconds Aug 17 07:13:01.334118 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 07:13:01.334212 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: *** Operational MODE: preforking *** Aug 17 07:13:01.334476 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: *** uWSGI is running in multiple interpreter mode *** Aug 17 07:13:01.334476 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: spawned uWSGI master process (pid: 81511) Aug 17 07:13:01.334651 dv-cinder-853126-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 17 07:13:01.336516 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: spawned uWSGI worker 1 (pid: 81522, cores: 1) Aug 17 07:13:01.336516 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: spawned uWSGI worker 2 (pid: 81523, cores: 1) Aug 17 07:13:01.336516 dv-cinder-853126-2-iscsi devstack@keystone.service[81511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 07:13:05.608143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:13:05.608143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: from cryptography.utils import int_from_bytes Aug 17 07:13:05.608886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:13:05.608886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: from cryptography.utils import int_from_bytes Aug 17 07:13:05.609031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:13:05.609031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Aug 17 07:13:05.609031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 07:13:05.609031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: from cryptography.utils import int_from_bytes Aug 17 07:13:05.660058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:13:05.660240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:13:05.660428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] command line args: [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:13:05.660693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:13:05.660780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 07:13:05.660861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ================================================================================ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:13:05.660938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 07:13:05.661080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] command line args: [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 07:13:05.661165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.661337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] config_dir = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.661421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 07:13:05.661517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ================================================================================ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 07:13:05.661606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.661678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] config_source = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.661771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] admin_token = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.661847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] debug = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_dir = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_source = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] debug = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.662866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_config_append = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_dir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.663981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_config_append = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_dir = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.664903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.665917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.666960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.667998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] publish_errors = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] publish_errors = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.668952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] standard_threads = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.669914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] use_journal = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] standard_threads = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] use_json = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] use_stderr = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] use_syslog = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_journal = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.670994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.671083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_json = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.671197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_stderr = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.671273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.671373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_syslog = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.671473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.671602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 07:13:05.671712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.671857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.671958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.672920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.673893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.674873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.675828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.676974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.677912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.678920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.679878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.680998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.681816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.682998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.683939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.684913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.685833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.686939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.687986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.688848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.689809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.690919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.691950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.692890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.693946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.694973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.695933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.external = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.external = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.696897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.password = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] auth.token = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.password = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.token = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.697825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.698943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.699970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.700928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701804 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.701883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.702927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.703879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.704830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.705475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.705565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.705732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.705811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.705983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.706959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.707970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.708899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.709919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.710987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.711918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.712936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.713869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.714972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.715900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.716993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.717939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.718975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.719925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.720087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.720164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.720321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.720405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.721953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.722917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.723879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.724972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.725921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.726970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.727898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.728858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.729985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] role.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] role.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.730927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.731976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.732948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.733914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.734961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.735938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.736945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.737947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.738932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.739874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.740970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.741922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.742955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.743972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.744911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.745849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.746981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.747921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.748000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.748071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:13:05.748150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.748388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 07:13:05.748558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 07:13:05.777691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.777919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.778167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.778341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.778575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.778801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.787577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.788167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.815211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.815439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.815820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.816055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.869407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.869727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.918228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.918458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.919126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:05.919364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.074889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.075029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.075112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.075241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.075331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.075455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.098619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.098852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.098936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.099965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.100047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.100186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.111093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.111648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.124999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81522) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.125835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 07:13:06.142474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.143172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 07:13:06.143512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.143629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.143712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 07:13:06.143839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 07:13:06.143969 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.144183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.144266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.144386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 07:13:06.144467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.144666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.144933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.145012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.145195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.145715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.154369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.154649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.154920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.155157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.155286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.155442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.155721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.156008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.162225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.163074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.165116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.165401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.165686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.165982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.166277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.166929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.167973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.168225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.168505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.168780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.191158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.192128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.192622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.192907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.193599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.193883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.197598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.197880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.198189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.198658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.198947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.199236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.204571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.204859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.206211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.206499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.209577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.209867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.210187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.210472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.210640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.210794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.210926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.211731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.212002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.212272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.212562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.228714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.228995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.229844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.230164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.232893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.234069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.236435 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.236739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.237612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.237913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.240986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.242207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.244155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.245354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.247422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.247721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.248999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.249241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.249532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.249817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.250146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.265362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.265661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.265929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.266219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.266681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.266984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.267257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.268138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.273667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.275380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.275514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.275775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.276931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.277212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.278431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.278718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.279002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.279301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.279578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.279893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.280182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.280467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.280765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.281043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.291322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.291604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.291885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.292167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.292449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.292729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.292854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.292993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.293127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.293388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.293673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.293980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.294271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.294551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.309069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.310651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.312154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.313726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.315656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.317097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.317224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.318615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.318745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.318895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.319181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.320159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.320453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.320752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.325727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.327221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.327349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.328763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.330188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.330492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.330780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.331056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.331726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.332029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.332320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.332597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.339108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.339400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.339683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.340655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.340976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.341261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.346671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81522) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.346954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.347237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.347511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.347782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 07:13:06.348351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.348920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.349923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.350029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.350207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81522) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.350292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.350484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.351272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.351272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.351272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.351545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.351805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 07:13:06.385407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5640f1e209c0 pid: 81522 (default app) Aug 17 07:13:06.387199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5640f1e209c0 pid: 81523 (default app) Aug 17 07:13:06.388785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37890-0968-4791-849c-d072e806fbfe None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:06.389071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37890-0968-4791-849c-d072e806fbfe None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:06.389343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37890-0968-4791-849c-d072e806fbfe None None] PATH_INFO: `/v3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:06.393528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed Aug 17 07:13:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:12.871937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:12.872452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:12.872452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:12.876752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:12.882082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:12.882461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:12.882623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:12.951986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: INFO dbcounter [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] Registered counter for database keystone Aug 17 07:13:12.971212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG oslo_db.sqlalchemy.engines [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:13:12.977270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writer thread running {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:13:13.154587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81522) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 07:13:13.154919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG passlib.handlers.bcrypt [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81522) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 07:13:13.209086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:13.210715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:13.336259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 07:13:13.837531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:13.905144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: INFO dbcounter [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] Registered counter for database keystone Aug 17 07:13:13.926579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG oslo_db.sqlalchemy.engines [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 07:13:13.932616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writer thread running {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 07:13:14.049856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf65c8-01de-4b91-bef6-bb870d176f2a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:14.054071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:14.054700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:14.054972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:14.055239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:14.063127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:14.114184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 07:13:14.114473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee991f1-dc6f-411e-a02b-c3e1fa6155e3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:14.123693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Aug 17 07:13:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:13:14.130312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:14.144647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061323a2-6041-4333-8b18-4f91202e0310 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:14.149049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:14.150182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:14.150485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:14.150754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] PATH_INFO: `/v3/projects/93dca03ccb1d4c01b8cd3b051645d149` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:14.152302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=93dca03ccb1d4c01b8cd3b051645d149)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:14.204433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 07:13:14.204774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2523fd-e6d4-4de1-a1e8-8037edcdf2a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:14.209287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Aug 17 07:13:14 2022] GET /identity/v3/projects/93dca03ccb1d4c01b8cd3b051645d149 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:16.068192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53384a4-4326-4d60-9c02-065e6f256664 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:16.068754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53384a4-4326-4d60-9c02-065e6f256664 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:16.068754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53384a4-4326-4d60-9c02-065e6f256664 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:16.072770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:16.078189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:16.078630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:16.078724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:16.098180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:16.099677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:16.107393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 07:13:16.370064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53384a4-4326-4d60-9c02-065e6f256664 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:16.382506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53384a4-4326-4d60-9c02-065e6f256664 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:16.386677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:16.387268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:16.387544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:16.387813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:16.395363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:16.397128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada0c4-792b-4e6e-bf5b-bbb93d236167 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:16.405631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Aug 17 07:13:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 07:13:16.410886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:16.419912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001bc3-23e8-45fb-85f0-c669b3bfbbbd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:16.424714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:16.425336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:16.425614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:16.425883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:16.427493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:16.429309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb9940-e6f4-4113-b47c-dc0a19e13f15 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:16.430855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed Aug 17 07:13:16 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:18.372558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9210-ed88-42f7-956b-6fc8c944eb8a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:18.373024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9210-ed88-42f7-956b-6fc8c944eb8a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:18.373114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9210-ed88-42f7-956b-6fc8c944eb8a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:18.374442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:18.379456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:18.379860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:18.380058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:18.397937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:18.399247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:18.420467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0afa-0e86-4b55-9095-67c658ebfd8b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:18.420746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0afa-0e86-4b55-9095-67c658ebfd8b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:18.421015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0afa-0e86-4b55-9095-67c658ebfd8b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:18.422370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:18.427363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:18.427645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:18.427918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:18.468774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG passlib.handlers.bcrypt [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81523) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 07:13:18.469206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG passlib.handlers.bcrypt [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81523) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 07:13:18.479950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:18.514858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:18.516420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:18.615491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:18.748153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:18.772868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:18.851466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa075b-31f3-4c83-a9eb-7dfb74ffa1b6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:18.880213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:18.884495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:18.885135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:18.885414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:18.885685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:18.897442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:18.906288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:18.907283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:18.908109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:18.913131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:18.981128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00108121-6c55-41a5-bbcb-8eb1a3e8d60e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:18.983370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:18.992652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:19.011236 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097c43a-b475-4b3b-8f50-581a3f965c26 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.018506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.019364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.019641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.019911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.046026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.046630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.046906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.047175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.047838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:19.048134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.050071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.061469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:19.067709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:19.088134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.089661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.164820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbe4b3-0210-4bb1-be14-4e351f2bcab3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.186520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:13:19.192570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:19.195239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:19.201197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.201832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.202220 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.202775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.203625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.205112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.206698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:19 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:19.212106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:19.225910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:19.289133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fd3c-427c-422f-8bb6-b4e82ae2fe55 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.311224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd162-7f8a-4e9d-82c9-5ba7d852bd01 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.322886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.323722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.323993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.324256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.342082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.343533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.344320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.344958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.345255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.345526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.346702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.348124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.349893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:19.355404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:13:19.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:19.364283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:13:19.365106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:13:19.365106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:13:19.365106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:19.365106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:19.370272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:19.426124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:19.437310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:19.457245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15b9f-ffc2-4d8c-92e9-2452dbfbdbb0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.469487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657178e-1129-46ab-9034-c09ae92fda6f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:19.493373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.494006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.494290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.494562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.495292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.domain.id=default, user.id=385e8184512a438fb380879d377e1eb7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:19.495595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.497057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4146-d8d2-4ed1-a7f9-31c25ec90ab5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.503809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Aug 17 07:13:19 2022] GET /identity/v3/role_assignments?user.id=385e8184512a438fb380879d377e1eb7&scope.domain.id=default&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:19.511685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:19.512321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:19.512602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:19.512873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:19.513536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:19.513835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:19.515327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760495ea-c0b3-43b0-a41f-3b5f1dd04f46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:19.537366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:21.634597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddea42-b854-4a5f-81b7-4f2db621c34b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.635747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddea42-b854-4a5f-81b7-4f2db621c34b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.636264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddea42-b854-4a5f-81b7-4f2db621c34b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.636895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5de53-196e-4066-ba2c-09f5bc8cc032 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.637283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5de53-196e-4066-ba2c-09f5bc8cc032 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.637442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5de53-196e-4066-ba2c-09f5bc8cc032 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.638959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 11/23] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:21.639288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 12/23] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:21.644228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c8fe-e30b-4fef-af86-4f0c263f7af0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.644789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c8fe-e30b-4fef-af86-4f0c263f7af0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.645064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c8fe-e30b-4fef-af86-4f0c263f7af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.658317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ca6-f643-45ab-bf07-1e7af5e21eaa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.658877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ca6-f643-45ab-bf07-1e7af5e21eaa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.659373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8ca6-f643-45ab-bf07-1e7af5e21eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.686000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0bce8ca6-f643-45ab-bf07-1e7af5e21eaa None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:21.686886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7c17c8fe-e30b-4fef-af86-4f0c263f7af0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:21.687737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0bce8ca6-f643-45ab-bf07-1e7af5e21eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:21.688036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7c17c8fe-e30b-4fef-af86-4f0c263f7af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:21.825199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:21.856287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:21.936796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7646-0c56-41bd-bd90-0a97e510ffcb None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.937093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7646-0c56-41bd-bd90-0a97e510ffcb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.937257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7646-0c56-41bd-bd90-0a97e510ffcb None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.939483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 13/26] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:21.944334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:21.944623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:21.944900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:21.971845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:21.973042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:22.042154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:22.217252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c7646-0c56-41bd-bd90-0a97e510ffcb None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.281476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:22.324453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.328177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:22.395353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c7646-0c56-41bd-bd90-0a97e510ffcb None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:22.467519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43f391-2b87-4ae5-b55b-da2cd19d7f0d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:22.498671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:22.499375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.499659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.499934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.506712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:22.507509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.508091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.508522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.519879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:22.525518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:22.525736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:22.526855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:22.527792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:22.528411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:22.529801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 15/28] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:22.537105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:13:22.561856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:22.562978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:13:22.564028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:13:22.564028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:13:22.564028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:22.569673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:22.571641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.647619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:22.690789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119120-d039-425a-908f-f0a2bdab2e20 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:22.713390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:22.719036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cec9-9db4-4ace-ac7d-3ded3cb97432 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:22.731369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:22.731990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.732417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.732713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.733506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:22.733812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:22.735744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:22.750055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 16/30] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:22.750055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.763160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:22.763927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.764309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.764670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.765546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:22.767274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f286c-1a38-431c-9362-0c391cfc5b14 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:22.870257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe4214-66ae-4e8f-ace2-12c2e291c63a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:22.898243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 15/31] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 17 07:13:22 2022] POST /identity/v3/roles => generated 219 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:22.899782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689c06-2230-41ac-a370-2913c76e0ef7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.900070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689c06-2230-41ac-a370-2913c76e0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.900345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689c06-2230-41ac-a370-2913c76e0ef7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.901626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 16/32] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:22.902398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689c06-2230-41ac-a370-2913c76e0ef7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:22.906155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:22.930615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:22.931243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.931523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.931795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:22.933776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:22.933910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:22.935448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19179d34-a61b-417a-8fb6-bec1a7bed5c9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:22.964027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 17/33] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:22.965301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:22.965589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:22.965861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.010577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:23.012716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:23.106707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689c06-2230-41ac-a370-2913c76e0ef7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:23.151882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 18/34] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:23.151882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:23.172090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:23.172964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.173421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.173820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.176761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:23.178528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:23.180252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 17/35] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:22 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:23.189989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:23.250493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:23.320086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06f1f-750b-4c17-a6d4-3bd388fffc1d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:23.340400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c06c3-a870-4ac1-860e-1902dfc5a6bb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:23.342729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:23.362066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:23.362677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.362952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.363217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.364097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:23.367738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa532dd-750c-4bc0-ba8f-1a546951d302 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:23.382039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:23.382781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.383126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.383468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.385257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:23.387025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b020e-dcb8-44bb-861f-07a3178ea2b4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:23.388912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 18/36] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:23.390135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd06de-4fab-483e-8f57-72d33a2c7195 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.390422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd06de-4fab-483e-8f57-72d33a2c7195 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.390685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd06de-4fab-483e-8f57-72d33a2c7195 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.391879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 19/37] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:23.397691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505f1f-5642-43c7-8aae-b22895e10c5f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.397996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505f1f-5642-43c7-8aae-b22895e10c5f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.398268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505f1f-5642-43c7-8aae-b22895e10c5f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.399645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 20/38] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:23.402756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505f1f-5642-43c7-8aae-b22895e10c5f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:23.499682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:23.508684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505f1f-5642-43c7-8aae-b22895e10c5f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:23.544493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:23.545179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.545460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.545733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] PATH_INFO: `/v3/domains/default/users/385e8184512a438fb380879d377e1eb7/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.547790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=385e8184512a438fb380879d377e1eb7, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:23.549841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530835bb-3634-415a-a690-527bfa5e848c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:23.565781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 21/39] 10.222.0.45 () {58 vars in 1361 bytes} [Wed Aug 17 07:13:23 2022] PUT /identity/v3/domains/default/users/385e8184512a438fb380879d377e1eb7/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:23.566869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.567153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.567432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.600285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:23.602323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:23.614037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 19/40] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:13:23 2022] POST /identity/v3/projects => generated 301 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:23.615666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.615954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.616222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.651963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:23.654735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:23.702970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:23.704195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:23.771764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 20/42] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:23.823474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:23.841780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623dad3-b35e-4676-99f8-7d669e58d17d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:23.881147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:23.881731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:23.882113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:23.882389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:23.883045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:23.884436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:23.899977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 23/43] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 17 07:13:23 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:24.003915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:24.070957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:24.129149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:24.133271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51a04c-fb47-4230-9cfb-de91872ed38c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:24.173050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:24.174370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:24.174649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:24.174961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:24.175578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:24.177560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:24.193911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 21/44] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 17 07:13:24 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:24.196340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee317e3-a34d-497d-8abf-02fc5f2aac26 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:24.233791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:24.234471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:24.234751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:24.235020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:24.237128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:24.238692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d9f2-e56e-4190-958f-d2e825eb631c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:24.240641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:24.246194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:24.354890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f84ae-6091-43c1-a954-0edbd32a2b9d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:24.390199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:24.390738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:24.391014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:24.391287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:24.391921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:24.393916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea281f-4108-4e3a-bd58-a48ff917f3b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:24.421452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:13:24 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:25.597160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7984-e099-4e8d-9a1b-a00fabfebb2c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:25.597684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7984-e099-4e8d-9a1b-a00fabfebb2c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:25.597684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7984-e099-4e8d-9a1b-a00fabfebb2c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:25.599132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:25.604548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:25.604954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:25.605041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:25.622681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:25.623846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:25.627106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:25.691460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:25.960720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7984-e099-4e8d-9a1b-a00fabfebb2c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:25.975782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:26.063476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f7984-e099-4e8d-9a1b-a00fabfebb2c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.096120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.096748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.097031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.097305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.108505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:26.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:26.116246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:26.117256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:26.122277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.218040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f645d6-5f9f-4870-829b-cf7a5b645257 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.251136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.251774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.252052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.252319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.252978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:26.253275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.254670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7afc-181e-4da2-82b1-8addd4927dc4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.262742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 24/50] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:26.268300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.294594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dfec-a524-4901-97c2-c93ec0c8f4c8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.294881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dfec-a524-4901-97c2-c93ec0c8f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.295160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5dfec-a524-4901-97c2-c93ec0c8f4c8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.296488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 25/51] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:26.302056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.302339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.302611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.308747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:26.321039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:26.322275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:26.338474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:26.370838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d0b5-6b53-4855-bbb0-5f64cb911679 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.389399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 26/52] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:26.403167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.403796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.404074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.404346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.405439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.406922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.408988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:26 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:26.414480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.510012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fee0b6-1126-46fa-a866-8aa97b1bbc7c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.538586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:26.543966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.544598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.544878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.545151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.546301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.547760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.549874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 27/54] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:26.555518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.651256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc634b1-f86e-4dd7-a7fd-819c82ad4e00 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.658630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.683932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.684544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.684826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.685102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.685820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.domain.id=default, user.id=385e8184512a438fb380879d377e1eb7) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:26.686156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.687607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.695363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Aug 17 07:13:26 2022] GET /identity/v3/role_assignments?user.id=385e8184512a438fb380879d377e1eb7&scope.domain.id=default&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:26.761358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fa889-177b-48bf-878b-6b0b3c08b552 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.797729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.798406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.798684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.798953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.800098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.801613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4444af2-6345-43f7-ae75-c82517121ae7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.803311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 28/56] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:26.809053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:26.812960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:26.912093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3d32e-789e-4a6c-ba58-e4fb2e46beef None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:26.944425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:26.945035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:26.945317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:26.945594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:26.946268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:26.947716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ba6-ff63-4771-abc2-ecdd4b0fc6a0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:26.974789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 29/57] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Aug 17 07:13:26 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:13:28.862410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0bdd-5bee-4545-8355-27fcdaedbebb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:28.862917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0bdd-5bee-4545-8355-27fcdaedbebb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:28.862999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0bdd-5bee-4545-8355-27fcdaedbebb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:28.864300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 29/58] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:28.869264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:28.869617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:28.869816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:28.887649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:28.888808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:28.938492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:28.955952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 30/59] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:29.224755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb0bdd-5bee-4545-8355-27fcdaedbebb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:29.290273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:29.324421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb0bdd-5bee-4545-8355-27fcdaedbebb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:29.356918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:29.357549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:29.357830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:29.358141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:29.359255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:29.360713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b74d9c-d468-4b0a-8003-70cc3e595c1e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:29.362581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 30/60] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:29.367923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:29.462671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f0ee6-2b78-4c1f-8c6b-b3923090e3dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:29.494893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:29.495435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:29.495715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:29.495985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:29.496627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:29.498095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3f363-cbdc-4c06-b251-6c675e1222c0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:29.523815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 31/61] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:29 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:32.341940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512ded-eba9-4cff-9dbb-a85d0bbce54a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.343004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512ded-eba9-4cff-9dbb-a85d0bbce54a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.343517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512ded-eba9-4cff-9dbb-a85d0bbce54a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.345105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 31/62] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:32.350567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655593-1fb5-4f3a-83d0-5e55a8e11ea2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.350897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655593-1fb5-4f3a-83d0-5e55a8e11ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.351112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9655593-1fb5-4f3a-83d0-5e55a8e11ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.378540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e9655593-1fb5-4f3a-83d0-5e55a8e11ea2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:32.380049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e9655593-1fb5-4f3a-83d0-5e55a8e11ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:32.431841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:32.476391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 32/63] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:32.575979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d3315-3d01-43c8-99c8-6aa438140b06 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.576326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d3315-3d01-43c8-99c8-6aa438140b06 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.576540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d3315-3d01-43c8-99c8-6aa438140b06 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.577905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 32/64] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:32.583658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154131-c227-460f-9f6d-65f22fe75027 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.583949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154131-c227-460f-9f6d-65f22fe75027 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.584229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154131-c227-460f-9f6d-65f22fe75027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.605929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-61154131-c227-460f-9f6d-65f22fe75027 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:32.607066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-61154131-c227-460f-9f6d-65f22fe75027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:32.689047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 33/65] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:32.820716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6a26-4382-46e9-84e8-505fe962b687 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.820716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6a26-4382-46e9-84e8-505fe962b687 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.820716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6a26-4382-46e9-84e8-505fe962b687 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.820716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 33/66] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:32.825860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:32.826177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:32.826456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:32.850574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:32.851762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:32.880649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6a26-4382-46e9-84e8-505fe962b687 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:32.964817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 34/67] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:33.018575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.041425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6a26-4382-46e9-84e8-505fe962b687 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.065702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.086051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.086989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.087494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.088021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.091028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.101522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b5bf6ea0-16ad-42fa-81e0-8c581dcddc91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:33.106672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:33.107607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:33.108399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:33.110757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 34/68] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:33.112877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cd891-b514-4f88-9021-e5671246bc2f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.113384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cd891-b514-4f88-9021-e5671246bc2f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.113928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cd891-b514-4f88-9021-e5671246bc2f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.115413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 35/69] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:33.124708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cd891-b514-4f88-9021-e5671246bc2f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.145741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a634e-6572-4a5b-869a-5c2570c22e18 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.182409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.183253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.183672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.184072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.195311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-34dd640a-56dc-44e9-b659-853de3fe7a17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:33.200654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:33.201480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:33.202296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:33.205161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:33.207977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.208449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.208912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.228086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:33.229651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:33.235729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cd891-b514-4f88-9021-e5671246bc2f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.275334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.275963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.276251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.276528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.277215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:33.277519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.279000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.289319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:33.291155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.352423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.396019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71933e2-3183-4370-b0db-aa5db93c1dbd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.407124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 36/72] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:33.408044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.431001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.431613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.431896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.432227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.432856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.432959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:33.433238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.434720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc503d-a955-4de2-8804-eddb89a287e4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.444157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:33.450441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de737b30-0b6f-464b-b328-1bd555c31bfc None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.450733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de737b30-0b6f-464b-b328-1bd555c31bfc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.451009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de737b30-0b6f-464b-b328-1bd555c31bfc None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.454002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 38/74] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:33.454002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de737b30-0b6f-464b-b328-1bd555c31bfc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.529747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511c0b8-f9d9-4dda-9b6c-c77d9db2d6dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.559574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de737b30-0b6f-464b-b328-1bd555c31bfc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.569305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.570132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.570590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.570855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.580785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.581153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:33.586334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:33.587208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:33.588000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:33.588694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.601493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.602167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.602448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.602721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.618003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.619496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9459b-643c-4650-8482-21ece2ee67aa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.621094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 39/76] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:33.622240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.622520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.622791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.641096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:33.642589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:33.681188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.699040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0feece-6036-4cfd-b3ae-5334d4989b2f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.712480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 40/77] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:33.713322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.733354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.733997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.734280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.734549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.736880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.738364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.739918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:33.745247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.816718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66b01-c6a9-46c2-a0e4-d53b133c3b0e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.827340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.850960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c5a2a-cee7-4deb-a0e6-2888b47791f7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:33.854647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.855417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.855832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.856241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.857039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:33.857494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.859153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.868194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 41/79] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:33.869114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:33.888270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:33.888875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:33.889151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:33.889424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:33.911605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:33.963888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:33.965353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:33.978159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d393-ee66-4762-8815-07f370a07a51 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.012194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.012825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.013104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.013378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.023895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:34.029062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:34.030049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:34.030822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 42/80] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:34.031456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.060986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.068562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:34.069405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.118415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.131264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6033f-c39c-4c7a-95ba-104e3fe608f2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.164826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.165428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.165704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.165996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.166908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435749ad-b5a5-452c-ae23-2857861086e9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.200689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.201300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.201577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.201845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.202978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.205001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.206583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 40/82] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.207341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.237160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.238609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.266862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.303956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dace97-faea-4607-a7fe-e00dc45d80bc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.321591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.336047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 43/83] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:34.338513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.338893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.339139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.339415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.339683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.340776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.342238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.343780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 41/84] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.344526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.440818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a484c97-8cd0-4616-9655-a767971973c7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.443184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793f6de-a10f-4334-ab28-309ee0afe0ab None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.468452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.474914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.475521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.475803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.476074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.476238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.476733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:34.476859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.477033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.477138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.477410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.478547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.478748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.479977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.487138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 42/85] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.487138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.487845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 44/86] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.488336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.536139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.580128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31c73-6761-4ea8-8916-678f7fbc0336 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.586493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e5c6-83da-48f3-85e4-2c1cf278a066 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.613889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.614513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.614785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.615053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.619868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.620492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.620774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.621047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.622203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.623653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.625447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 45/87] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.626191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.683379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.686311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.687773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.724486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e285fc-2f4a-424e-a831-bddb8ff84a34 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.740286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.759192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.759797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.760082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.760357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.760998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.762488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.784701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 43/88] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:34.786913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.788287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 46/89] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:34 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:34.789361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.899047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33483661-2109-41f0-81ef-15d2ebb449d0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.909227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224529fb-1b31-4013-a325-cf4001ef5fec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:34.918697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:34.943624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.944268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.944545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.944816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.946222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.947810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.949882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 47/90] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.950247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.951999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:34.952802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:34.953217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:34.953631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:34.954669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:34.954980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:34.956441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:34.962545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 44/91] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=9e04db42a455473b8b84df28c1a357fc => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:34.963285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:34.984966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:35.097294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f372-beb0-4a2a-9218-a36ef520c4d2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.098121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba35d03-5bfb-4731-8159-b466e3d09dbc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.139366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.139805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.140029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.140260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.140445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.140538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.140731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.141007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.141253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=385e8184512a438fb380879d377e1eb7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:35.141555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.142741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.143632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.144189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.145987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 45/92] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:35.146802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:35.151098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 48/93] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:34 2022] GET /identity/v3/role_assignments?user.id=385e8184512a438fb380879d377e1eb7&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:35.153035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:35.234384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:35.268141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:35.285830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be7032-6171-4f23-a6b0-33f3e12d7c4a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.303137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea4988-e9e6-4dd0-a2b4-9c6b2aceb631 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.327978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.328711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.329002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.329383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.368965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.370545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.370545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.370545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.370899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:35.373830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.375708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.384882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 49/94] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:35 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:35.432330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.433881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.543231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:35.567046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 46/95] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:35.573203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:35.726964 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afecdf-131d-4087-89e7-0057d9fcf1d4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.750363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:35.783036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.783705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.783989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.784266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] PATH_INFO: `/v3/projects/eeb2392d58324cf7be553dc202dfb688` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.785436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb2392d58324cf7be553dc202dfb688)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.786984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d47d35-8421-41f9-8fee-7cc167db33a6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.788971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 50/96] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:35 2022] GET /identity/v3/projects/eeb2392d58324cf7be553dc202dfb688 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:35.794681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:35.926095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fcd16-b3f9-4e4b-bd36-30157df61d5e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:35.965441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:35.966079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:35.966366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:35.966644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:35.967374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=eeb2392d58324cf7be553dc202dfb688, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:35.967680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:35.969249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f7f1a-c11b-4496-bba5-56c2dc67b85f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:35.975841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 47/97] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:35 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=eeb2392d58324cf7be553dc202dfb688&role.id=9e04db42a455473b8b84df28c1a357fc => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:37.683803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e1ed-2357-440f-bc09-90eb7e14fcb6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.684272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e1ed-2357-440f-bc09-90eb7e14fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.684272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024e1ed-2357-440f-bc09-90eb7e14fcb6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.685843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 51/98] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:37.687336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015778d-fc8b-47cb-82dd-4268f0f4d3c7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.687741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015778d-fc8b-47cb-82dd-4268f0f4d3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.687901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015778d-fc8b-47cb-82dd-4268f0f4d3c7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.689358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 48/99] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:37.691017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7297f51-ca57-4926-93cc-5d0a05777e38 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.691305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7297f51-ca57-4926-93cc-5d0a05777e38 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.691582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7297f51-ca57-4926-93cc-5d0a05777e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.697330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daee8b-d472-43e7-8624-87be2221d15e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.697617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daee8b-d472-43e7-8624-87be2221d15e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.697891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daee8b-d472-43e7-8624-87be2221d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.725424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f7297f51-ca57-4926-93cc-5d0a05777e38 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:37.726672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f7297f51-ca57-4926-93cc-5d0a05777e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:37.741640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-12daee8b-d472-43e7-8624-87be2221d15e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:37.742865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-12daee8b-d472-43e7-8624-87be2221d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:37.837203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:37.866043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 49/100] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:37.879474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994ffe-bd1b-420f-a599-5994043b6e4b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.879959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994ffe-bd1b-420f-a599-5994043b6e4b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.880378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84994ffe-bd1b-420f-a599-5994043b6e4b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.882922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 50/101] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:37.887622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3636-e11e-45dd-be95-2dafb7c19f32 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.888890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3636-e11e-45dd-be95-2dafb7c19f32 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.889307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c3636-e11e-45dd-be95-2dafb7c19f32 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.890719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 51/102] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:37.891611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 52/103] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:37.896671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.897122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.897556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.901922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155c1-d2e4-4b85-b80f-cf4f79bbccb7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:37.902387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155c1-d2e4-4b85-b80f-cf4f79bbccb7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:37.902807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155c1-d2e4-4b85-b80f-cf4f79bbccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:37.936636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:37.937788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ed1155c1-d2e4-4b85-b80f-cf4f79bbccb7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:37.939674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:37.940982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed1155c1-d2e4-4b85-b80f-cf4f79bbccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:38.048772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 52/104] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:38.068265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 53/105] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 07:13:38.270116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.378764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fec48-b398-4607-8a3d-340b16612172 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.389782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:38.414033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23259-624c-432f-8cb5-81929f8ff199 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.414404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23259-624c-432f-8cb5-81929f8ff199 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.414593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23259-624c-432f-8cb5-81929f8ff199 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.415958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 54/106] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:38.418682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.419311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.419586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.419853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.420957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:38.422586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a890a-6eaa-44db-9539-8acf177b239a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:38.423622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e23259-624c-432f-8cb5-81929f8ff199 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.424774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 53/107] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:38.430922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.431204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.431477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.450703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:38.451939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:38.474112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:38.543095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 54/108] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:38.543840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.548526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e23259-624c-432f-8cb5-81929f8ff199 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.586223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.586881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.587160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.587430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.598545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:38.603306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:38.604177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 55/109] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:38.605357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.681943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6c9d6-48d9-4952-b823-310fbfd8a419 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.691477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:38.718046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.718624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.718901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.719172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.720339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:38.721709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:38.722153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:38.726316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00615a0-c6b4-4e4c-a536-20a84e9d0a5e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.750942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 55/110] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:13:38 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:38.752393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.772772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.773860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.774412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.774926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.788095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:38.793808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:38.794686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:38.795757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:38.798409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 56/111] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:38.799611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.868395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52a097-6b12-435d-a0a8-56872868e48d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.907655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.908356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.908638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.908905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.920882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:38.922100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ef0-8880-46ad-8836-3ea854564ae3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:38.925820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:38.926735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:38.927755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 56/112] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:38.928515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:38.959233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:38.969159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:38.969935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:38.970440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:38.970687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:38.971472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:38.972469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:38.973221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:38.983955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 57/113] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:38.984609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.016256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.049735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc5fc-cb60-4644-a053-7d2dba90dbf8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.084576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.085192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.085479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.085758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.086463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:39.086767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.088170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.100419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 57/114] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.101252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.123145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7379-c951-40eb-8f17-b6c467d1a13d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.158628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.159267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.159550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.159824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.170056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:39.175820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:39.176666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:39.177736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 58/115] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:39.182333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.194312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.213878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d202a-867c-4a40-a8d1-f952a5dd3363 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.252407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.253030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.253313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.253588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.254279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:39.254587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.255974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b9f6-bd3f-431c-a140-c10b0d6bfd1a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.264159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 58/116] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.265348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874e41-0d28-444c-99d6-d3ff3a65bd5d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.265635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874e41-0d28-444c-99d6-d3ff3a65bd5d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.265911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874e41-0d28-444c-99d6-d3ff3a65bd5d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.267186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 59/117] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:39.270290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45874e41-0d28-444c-99d6-d3ff3a65bd5d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.274705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.294896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b6b0-d12d-4f0d-8e44-cdb0ba51c908 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.328972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.329628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.329919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.330230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] PATH_INFO: `/v3/users/0bb98f33890c40268843c880761819c9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.345994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] RBAC: Authorizing `identity:get_user(user_id=0bb98f33890c40268843c880761819c9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.347754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.349674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 59/118] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/users/0bb98f33890c40268843c880761819c9 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.356162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.394890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45874e41-0d28-444c-99d6-d3ff3a65bd5d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.429192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.429824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.430139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.430412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.431538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.433076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.434930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 60/119] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.435466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.450390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.468847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72885eb-9f3a-49a8-8990-f8e37ef5f0cd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.508196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.508802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.509075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.509341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.510017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:39.510313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.511692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b228ca3-b19b-4dfb-89df-184dc3c4b6d9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.519654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 60/120] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.524349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.524642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.525761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.532931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.543829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c214a3-ec08-4164-b07c-fd8addaf1dc7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.546755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:39.547442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:39.579509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.580067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.580349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.580620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.581719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.583185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.584752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 61/121] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.585504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.618235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 61/122] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:39.626843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.690299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.716476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49abe0-0d14-49f5-ba7b-45962376f494 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.759782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.760558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d91ae-4a42-4ac3-92b4-e3279c357f08 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.761170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.761629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.762291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.800113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.808551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.809195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.809477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.809745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.810934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.812397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.814627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 62/123] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.820514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.854876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.856285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.938676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f73ec7-c891-46b1-820e-d634082e5b0c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:39.946886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:39.974343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 62/124] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:39.975386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:39.977692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:39.978362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:39.979424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:39.979701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:39.980834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:39.982310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:39.984463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 63/125] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:39.987046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.057124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.083436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c824d3-d91a-4ea1-b182-40b113c6e503 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.093117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bfd6f-ceb2-487c-ba9d-ec0e91eea8c0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.122469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.123066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.123315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.123593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.124690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.126827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.127253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.127904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.128182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.128454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/123dc2eb7c274f66afcf8d8f76978485/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.134045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 63/126] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:39 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:40.134045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.135271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, user_id=123dc2eb7c274f66afcf8d8f76978485, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.136721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.151516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 64/127] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:39 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/123dc2eb7c274f66afcf8d8f76978485/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:40.158159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.202411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.260754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd3ab-c47c-4bb6-a720-a1fccbda985b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.298667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bda543-8a4f-4b3b-9680-b33f7792d208 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.311986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.312918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.313200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.314053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.328601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:40.330455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:40.334834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:40.335752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:40.336669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 64/128] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:40.337476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.351722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.352629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.353186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.353456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.356360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.357572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.359532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 65/129] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:40.360298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.463287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb78fb8-bae9-49bd-8cc2-6ae73cffaa98 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.475482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.495855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca60938-5ec0-47d7-939f-1036f4db5cc8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.511584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.512603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.513291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.513743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.515446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.517625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.524393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 65/130] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:40.524393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.544057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.545381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.545858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.546337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/385e8184512a438fb380879d377e1eb7/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.549372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, user_id=385e8184512a438fb380879d377e1eb7, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.551734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.571627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 66/131] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:40 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/385e8184512a438fb380879d377e1eb7/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:40.573295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.638954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33126c0e-b20f-4aa1-b3b4-a87ece75479c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.655230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.702142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.702767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.703043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.703311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.703989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:40.704327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.706692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.725142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 66/132] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:40.725993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.755201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06f59-3a23-4d16-807b-84405571611b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.795718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.796444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.796627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.796888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.797628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=0bb98f33890c40268843c880761819c9) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:40.799821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.800019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.805828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 67/133] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/role_assignments?user.id=0bb98f33890c40268843c880761819c9&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=39b78c9526634786853a4e1eff655d03 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:40.806673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:40.819722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.897348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebe84b-3335-43d1-a717-0872390f34c8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.940550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.941055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35f26-543c-413d-9f0c-613de8bd2295 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:40.941727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.942204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.942865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/123dc2eb7c274f66afcf8d8f76978485/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.947064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, user_id=123dc2eb7c274f66afcf8d8f76978485, role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.949647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d944df4-f937-4b62-b535-545dfe691994 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:40.964106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:40.971154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 67/134] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:40 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/123dc2eb7c274f66afcf8d8f76978485/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:40.973330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e934-a4dd-49fb-a0c1-42171c37a841 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.974136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e934-a4dd-49fb-a0c1-42171c37a841 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.974630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e934-a4dd-49fb-a0c1-42171c37a841 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.977541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 68/135] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:40.983852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.984033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.984261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.993918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:40.994654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:40.994936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:40.995213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:40.996572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:40.999196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:41.001740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 68/136] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:40 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:41.008696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:41.026288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:41.027591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:41.150867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 69/137] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:41.195405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419652a-cf14-4282-a2a4-69df949a9bca None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:41.248716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:41.249279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:41.249559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:41.249827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] PATH_INFO: `/v3/projects/eeb2392d58324cf7be553dc202dfb688` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:41.251016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb2392d58324cf7be553dc202dfb688)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:41.252569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:41.254219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 69/138] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:41 2022] GET /identity/v3/projects/eeb2392d58324cf7be553dc202dfb688 => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:41.260106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:41.300752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:41.390393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351fcf-d4d3-412c-ae04-d180135f646e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:41.431592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:41.432255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:41.432532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:41.432803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] PATH_INFO: `/v3/projects/eeb2392d58324cf7be553dc202dfb688/users/123dc2eb7c274f66afcf8d8f76978485/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:41.436287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2392d58324cf7be553dc202dfb688, user_id=123dc2eb7c274f66afcf8d8f76978485, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:41.437749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:41.462383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 70/139] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:41 2022] PUT /identity/v3/projects/eeb2392d58324cf7be553dc202dfb688/users/123dc2eb7c274f66afcf8d8f76978485/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:41.504914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:41.583208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:41.644652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833f978-8bbb-4a6a-a914-fe13cd70d0b6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:41.680669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:41.681306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:41.681592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:41.681874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:41.683030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:41.684495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c6512-03fa-4f05-a856-cafa1169f091 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:41.686392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 70/140] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:41.692419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:41.800706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:41.818917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef212b6-12b1-44b7-9cf9-3cd28d3c58a8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:41.865196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:41.865815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:41.866122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:41.866389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:41.867046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:41.868480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6978f-6fee-4740-8558-796c7f0cc6ae None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:41.895593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 71/141] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:41 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:42.759851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b597-ade9-472d-aafb-ac3c51270128 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:42.760377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b597-ade9-472d-aafb-ac3c51270128 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:42.760454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b597-ade9-472d-aafb-ac3c51270128 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:42.761763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 71/142] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:42.767528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b669-7b80-488b-a2ab-b917040c2638 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:42.767867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b669-7b80-488b-a2ab-b917040c2638 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:42.768175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b669-7b80-488b-a2ab-b917040c2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:42.790417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d093b669-7b80-488b-a2ab-b917040c2638 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:42.791625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d093b669-7b80-488b-a2ab-b917040c2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:42.877123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 72/143] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:43.351905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3719c2-4410-4163-8e23-9063e0b1a84c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.352192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3719c2-4410-4163-8e23-9063e0b1a84c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.352468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3719c2-4410-4163-8e23-9063e0b1a84c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.353830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 72/144] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:43.359417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1773000-f713-46ce-8cb7-61455e9d48c1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.359713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1773000-f713-46ce-8cb7-61455e9d48c1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.359999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1773000-f713-46ce-8cb7-61455e9d48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.395104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b1773000-f713-46ce-8cb7-61455e9d48c1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:43.396320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b1773000-f713-46ce-8cb7-61455e9d48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:43.448355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3719c2-4410-4163-8e23-9063e0b1a84c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:43.499300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 73/145] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:43.566022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590103d5-6adb-40c8-a7b3-aa42198152bd None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.566325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590103d5-6adb-40c8-a7b3-aa42198152bd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.566594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590103d5-6adb-40c8-a7b3-aa42198152bd None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.568356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 74/146] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:43.576897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.577295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.577588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.593493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:43.607026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3719c2-4410-4163-8e23-9063e0b1a84c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:43.615015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:43.616228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:43.650997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:43.666745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:43.667396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.667676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.667953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.687011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:43.691904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:43.692822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:43.693597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 73/147] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:43.701809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:43.747319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 75/148] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:43.849885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deff0-8b8b-4eac-9cf4-860deb29b8de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:43.890819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:43.891326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:43.892222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:43.892506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:43.893172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:43.893474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:43.894907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:43.910662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 74/149] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:43.916527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.020553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.061409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568e51-2580-4e0a-adb1-c14783237fd0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.102859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.103723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.104162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.104620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.105870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:44.107890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:44.110151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 76/150] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:43 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:44.112070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.119263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.123134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.229092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5c734-c6ea-4efd-9751-4ec215dfe372 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.278511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.279548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.280108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.280580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.291967 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-eb5f5d0f-d2ad-4223-a1f1-ff843e1ca3e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:44.302121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:44.303029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:44.303798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:44.305774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd63793-f910-4cf0-9a99-dd402a27f49c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.306406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 75/151] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:44.307784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d359-cdaa-439f-acfc-f809db86cfb2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.308273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d359-cdaa-439f-acfc-f809db86cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.308728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928d359-cdaa-439f-acfc-f809db86cfb2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.310230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 76/152] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:44.314843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d359-cdaa-439f-acfc-f809db86cfb2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.406671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.407331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.407621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.407890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.432318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928d359-cdaa-439f-acfc-f809db86cfb2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.440779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.470106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.471058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.471553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.472012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.472862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:44.473348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:44.474936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728fc00-8863-4bfa-97d1-976f93875a11 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:44.483859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 77/153] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:44.485870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.486383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.487190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.505783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:44.507466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:44.574990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:44.576501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:44.577317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 78/154] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:44.578500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.579554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.690250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8fb27-693a-4379-9e29-80faab36e6bf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.703093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.745679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.746639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.747106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.747676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.763761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:44.769167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:44.770041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:44.771052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:44.773541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 79/155] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:44.778690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.797552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 77/156] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:44.803038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.905793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb502-3172-44af-a3bf-777b27e53f7f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.946770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290676-0aec-45c3-ac8e-f8324825a50d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:44.947745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:44.952131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:44.953003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:44.953492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:44.954626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] PATH_INFO: `/v3/users/385e8184512a438fb380879d377e1eb7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:44.955995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] RBAC: Authorizing `identity:get_user(user_id=385e8184512a438fb380879d377e1eb7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:44.957675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:44.959564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 80/157] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/users/385e8184512a438fb380879d377e1eb7 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:44.960513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:44.990326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:45.003525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.004071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.004351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.004628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.005304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:45.005601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:45.007006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590766fc-1418-4dcb-96c0-bd4e1e742fe2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:45.021479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 78/158] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:45.022728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231211-e68b-4fbe-9b16-c658affa3b66 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.023137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231211-e68b-4fbe-9b16-c658affa3b66 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.023352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68231211-e68b-4fbe-9b16-c658affa3b66 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.024834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 79/159] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:45.025523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68231211-e68b-4fbe-9b16-c658affa3b66 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.072326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444c2e-07a2-4d29-8943-145e3fb62f1f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:45.111184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.112441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.112911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.113373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.114705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:45.116461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:45.118320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 81/160] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:44 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:45.119380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.215739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68231211-e68b-4fbe-9b16-c658affa3b66 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:45.222314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:45.227921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e2da3-cb57-4487-8d0a-fafdd9cd0208 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:45.264463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.265372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.265881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.266358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] PATH_INFO: `/v3/users/0bb98f33890c40268843c880761819c9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.268334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb98f33890c40268843c880761819c9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:45.270167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63147e-b9da-48ea-a22a-63d4c09bda98 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:45.272338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 82/161] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/users/0bb98f33890c40268843c880761819c9 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:45.273747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.274265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.274723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.295078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:45.296675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:45.318952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.319274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.319554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.319826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.369681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 83/162] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:45.377982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.385291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:45.538677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:45.538677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ad665-e6b9-4361-b5e4-5909d304d73f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:45.542768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:45.544783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:45.601061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.601759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.602164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.602550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.603528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:45.603925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:45.605494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:45.623432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 84/163] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=9e04db42a455473b8b84df28c1a357fc => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:45.624192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.853293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4e787-24f5-4256-a242-f1cae4974ab9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:45.886898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 80/164] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:45.888072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.893992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:45.893992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:45.893992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:45.893992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:45.902413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:45.907986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:45.909566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:45.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:45.911420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 85/165] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:45.917065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:45.955408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.011240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.052324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3719a-c5dc-42a0-94bb-129c0b63d99f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.089091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.089734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.090047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.090318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.096784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5f22-068c-4257-a448-d7328b363b13 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.101302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:46.107050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:46.107927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:46.108745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 86/166] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:46.109440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.156125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.156800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.157578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.157883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.162651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.164128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.166069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 81/167] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:45 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.166609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.214347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.258787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2b36-3bc8-4d69-84c6-7494a0ac24b9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.307002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.307754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.308031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.308301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.308960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb839-46b6-4977-a9c5-73a44b1859ed None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.309430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.312080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.314012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 87/168] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.314580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.353146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.361515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.362412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.362687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.362955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.363631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:46.363931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.370671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.381392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 82/169] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.382092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.452885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c476f2-2e17-4e78-b696-2bcce869df23 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.488287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.488896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.489175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.489445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.490124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:46.490424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.491802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11ea0-489d-4c04-bdaf-594b8e7a5a3b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.499723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f9fa2-5bd0-4acb-af26-cf4c98b83d72 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.500184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 88/170] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.501927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb614e-142a-4ee5-8ceb-25d5c85846df None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.502252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb614e-142a-4ee5-8ceb-25d5c85846df None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.502512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb614e-142a-4ee5-8ceb-25d5c85846df None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.503875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 89/171] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:46.506453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb614e-142a-4ee5-8ceb-25d5c85846df None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.516141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.539678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.540333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.540612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.540884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/0bb98f33890c40268843c880761819c9/roles/39b78c9526634786853a4e1eff655d03` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.542781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, user_id=0bb98f33890c40268843c880761819c9, role_id=39b78c9526634786853a4e1eff655d03)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.544222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.556736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 83/172] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:46 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/users/0bb98f33890c40268843c880761819c9/roles/39b78c9526634786853a4e1eff655d03 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:46.557539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.623469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb614e-142a-4ee5-8ceb-25d5c85846df None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.625483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.660258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.660877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.661158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.661424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.662198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=385e8184512a438fb380879d377e1eb7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:46.662499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.664005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472f8f-cc21-485a-adf8-7dd0a9713add None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.670246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 90/173] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/role_assignments?user.id=385e8184512a438fb380879d377e1eb7&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.671726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fb9-4dee-442c-974c-593514c8cfc8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.672006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fb9-4dee-442c-974c-593514c8cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.672272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd0fb9-4dee-442c-974c-593514c8cfc8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.674238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 91/174] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:46.679079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0fb9-4dee-442c-974c-593514c8cfc8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.689901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2023daf-25af-4adb-b86f-080b95da4e28 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.738691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.739341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.739621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.739968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.741492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.743501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35496de0-0fc7-4803-b237-d3cd91f44aea None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.744446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 84/175] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.745469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbe44-1363-4747-a774-a5d9407d52ae None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.745750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbe44-1363-4747-a774-a5d9407d52ae None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.746290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbe44-1363-4747-a774-a5d9407d52ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.768746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-53ebbe44-1363-4747-a774-a5d9407d52ae None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:46.770055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53ebbe44-1363-4747-a774-a5d9407d52ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:46.798886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:46.849824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd0fb9-4dee-442c-974c-593514c8cfc8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:46.862502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 85/176] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:46.864134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc8ba-4b48-455f-bc2a-8fcca0d2830b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.864566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc8ba-4b48-455f-bc2a-8fcca0d2830b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.864980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bc8ba-4b48-455f-bc2a-8fcca0d2830b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.866520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 86/177] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:46.867725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01012487-730a-416b-878a-7fa79c31b3a6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.868213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01012487-730a-416b-878a-7fa79c31b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.868637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01012487-730a-416b-878a-7fa79c31b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.897867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-01012487-730a-416b-878a-7fa79c31b3a6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:46.899124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01012487-730a-416b-878a-7fa79c31b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:46.899269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:46.899822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:46.900096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:46.900508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] PATH_INFO: `/v3/users/123dc2eb7c274f66afcf8d8f76978485` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:46.901814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] RBAC: Authorizing `identity:get_user(user_id=123dc2eb7c274f66afcf8d8f76978485)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:46.903781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:46.905217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 92/178] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/users/123dc2eb7c274f66afcf8d8f76978485 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:46.906599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:46.977373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.004936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 87/179] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:47.007181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.011679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.011679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.042296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:47.044632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:47.050032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9143-d999-478e-84d6-7b1d86e54245 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.093079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.093927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.094229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.094497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.104321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.173745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:47.175540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:47.187955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 88/180] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:47.189480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.326395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 93/181] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:47.332170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.380548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dabd14b-5dfa-4470-b65d-3b0195a8d51c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.391479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.397792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.422405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.423636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.424007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.424227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.472968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45caaff-79d8-43b3-a8bb-6526a0e8a77d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.498452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:47.500303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:47.518240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.519264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.520052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.520483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.521726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:47.523966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:47.526270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 94/182] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:47.527264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.609316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:47.609989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.623596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.634521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a89a-084c-4471-96b6-c31dcf8d1f29 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.642153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.670714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.671597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.672027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.672428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.682787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:47.687642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:47.689235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:47.690212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:47.691157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 95/184] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:47.691951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.727909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c49409-e810-4a1c-9b4e-a5252f966fce None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.762547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.763169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.763446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.763712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.764807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:47.766267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:47.768096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 90/185] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:47.768669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.808167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99366-926e-4f3f-bb94-48786b57e512 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.843484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.844340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.845331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.845789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.853203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.856441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:47.861970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:47.863006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:47.863951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 96/186] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:47.864794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.881205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ef8c-b363-49e1-9a81-ba9e5e127bd5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:47.892465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:47.924196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:47.925265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:47.926028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:47.926542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:47.927324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:47.929549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:47.957075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 91/187] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:47 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:47.959242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:47.984377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00021c9-f7ff-4622-9469-fdc173c2394d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.026490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.027229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.027672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.028012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] PATH_INFO: `/v3/projects/eeb2392d58324cf7be553dc202dfb688` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.029382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] RBAC: Authorizing `identity:get_project(project_id=eeb2392d58324cf7be553dc202dfb688)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.031160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.033827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 97/188] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/projects/eeb2392d58324cf7be553dc202dfb688 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.034808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.089792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb633c14-6033-4d40-91a5-0b1e87b38d49 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.130755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.131514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.131896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.132269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.132950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:48.133256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.134712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.137547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.145855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 92/189] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.146833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.169933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.177609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471f508-f2f0-4e79-a14e-fcfdbd506056 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.220501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.221033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.221310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.221583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.222347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:48.222654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.224113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.231009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 98/190] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.231823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.281154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851237e8-e201-4172-8446-3d34fc8a5725 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.325830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.326508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.326787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.327056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.327840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:48.328144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.330317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.340740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 93/191] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.342440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.383350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5ee1e-fb54-41f8-b5a6-82c11de44117 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.426785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.427391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.427771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.428036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.428562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.429658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=eeb2392d58324cf7be553dc202dfb688, user.id=123dc2eb7c274f66afcf8d8f76978485) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:48.429990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.431472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.440340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 99/192] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/role_assignments?user.id=123dc2eb7c274f66afcf8d8f76978485&scope.project.id=eeb2392d58324cf7be553dc202dfb688&role.id=9e04db42a455473b8b84df28c1a357fc => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.441184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.484542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.500297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4ed0a-773f-43cc-94a5-a4faea746466 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.548111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.548755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.549033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.549299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.567584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.569097 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.570881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 94/193] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.576628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.588123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a18db-517a-41d5-a545-9f18ed0bdefe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.628535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.629170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.629448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.629719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.631127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.632714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.634872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 100/194] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:48.640454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.691431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a0d8-a30d-47e2-81c3-b8d71785845d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.717322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.733181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.733797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.734104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.734374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.745180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:48.756313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fd58a-9aa3-47da-9cbc-9df334d3add0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:48.798230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:48.798842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.799146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.799482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.823273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.825435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbf3f7-d776-4c35-998f-95e3dbfcb76e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.880095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:48.881704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2aee5a-dab3-482b-bdb6-deadb224a239 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:48.961812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 95/195] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:13:48.962939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4676-2132-451a-ac99-d70315e31be0 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:48.963224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4676-2132-451a-ac99-d70315e31be0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:48.963495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4676-2132-451a-ac99-d70315e31be0 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:48.964866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 96/196] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:48.969714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4676-2132-451a-ac99-d70315e31be0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:48.997885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:49.007061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:49.024172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 101/197] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:13:49.025623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.025912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.026208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.044330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:49.045519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:49.103429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4676-2132-451a-ac99-d70315e31be0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.115160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 102/198] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:49.115910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.141573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.142702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.143305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.143842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.145281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:49.147096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:49.149459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 97/199] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:48 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:49.163382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.221454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719e77a-ad3b-4e25-b1a3-25b51a5c8a7f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.242478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:49.256906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.257472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.257742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.258031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.259132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:49.260581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:49.266015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 103/200] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:49.274629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.328841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:49.354278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e025da-2651-40ca-a1c5-b8e26e8ed6f2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.419373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04391-df94-4879-afff-a329ab277dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.419977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04391-df94-4879-afff-a329ab277dae None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.420248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04391-df94-4879-afff-a329ab277dae None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.422699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04391-df94-4879-afff-a329ab277dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.423936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04391-df94-4879-afff-a329ab277dae None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=27861b6659c14bd48cd9577a265252ee) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:49.424242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04391-df94-4879-afff-a329ab277dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:49.425669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04391-df94-4879-afff-a329ab277dae None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:49.439544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 98/201] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/role_assignments?user.id=27861b6659c14bd48cd9577a265252ee&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:49.447066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04391-df94-4879-afff-a329ab277dae None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.457697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253f8f7-6eae-41a8-b374-8fd3f5fb7838 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.494702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.495317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.495592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.495861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.496607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=27861b6659c14bd48cd9577a265252ee) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:49.496976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:49.498465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:49.504334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 104/202] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/role_assignments?user.id=27861b6659c14bd48cd9577a265252ee&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:49.592210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04391-df94-4879-afff-a329ab277dae None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.631313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.631975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.632253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.632525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.645277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:49.650825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:49.651770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:49.652631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 99/203] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:49.658712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.724859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:49.785554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe0b94-7595-4352-bdef-3066929ba1cc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:49.825544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:49.826185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:49.826463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:49.826730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:49.827402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:49.827701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:49.829691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:49.843796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 105/204] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:49.849571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:49.873548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:50.002496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762a73-a64c-4f0c-a928-7b103b4a6d05 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:50.050747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:50.051726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.052207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.052698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] PATH_INFO: `/v3/users/0bb98f33890c40268843c880761819c9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.058652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] RBAC: Authorizing `identity:get_user(user_id=0bb98f33890c40268843c880761819c9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:50.060367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:50.062301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 100/205] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:49 2022] GET /identity/v3/users/0bb98f33890c40268843c880761819c9 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:50.068612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:50.201719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede3c16-3395-4360-ad6d-517ab4f059b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:50.216504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:50.247132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:50.247741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.248015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.248328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.335391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:50.336867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:50.476360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 106/206] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:50.481840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:50.614327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:50.642175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45c3a0-5d62-4ff0-9605-7fc099efafe8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:50.686713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:50.687403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.687679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.687945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.689154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:50.690744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ce313-d96b-436f-9dc7-1df0c81b6bc2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:50.692555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 101/207] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:50 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:50.698200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:50.727227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:50.768972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f83d-75a3-4faf-8401-b3e5e6945fce None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.769687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f83d-75a3-4faf-8401-b3e5e6945fce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.769982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391f83d-75a3-4faf-8401-b3e5e6945fce None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.771850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 102/208] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:13:50.784773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c8369-6ee1-4fdf-a1c7-07b0cb023f5f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.785094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c8369-6ee1-4fdf-a1c7-07b0cb023f5f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.785313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c8369-6ee1-4fdf-a1c7-07b0cb023f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.807195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bb0c8369-6ee1-4fdf-a1c7-07b0cb023f5f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:50.808370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bb0c8369-6ee1-4fdf-a1c7-07b0cb023f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:50.882952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376546c9-a22f-4a7d-8067-bb758398d566 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:50.922452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:50.924341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:50.924620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:50.924888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:50.926309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, scope.project.id=19d5e4d06504401c9195a9ad55640c4b, user.id=0bb98f33890c40268843c880761819c9) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:50.926618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:50.928062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc7bc5-c6a4-4689-a593-f96cf0e683db None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:50.938012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 103/209] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:50.941419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 107/210] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:50 2022] GET /identity/v3/role_assignments?user.id=0bb98f33890c40268843c880761819c9&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=39b78c9526634786853a4e1eff655d03 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:51.062335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812deaa0-5ae3-4b12-85c2-0f224306cfbf None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.062512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812deaa0-5ae3-4b12-85c2-0f224306cfbf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.062788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812deaa0-5ae3-4b12-85c2-0f224306cfbf None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.064489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 104/211] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:51.070067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.070366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.070636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.099472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:51.100679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:51.186463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 108/212] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:51.335090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812deaa0-5ae3-4b12-85c2-0f224306cfbf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:51.426047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:51.455229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812deaa0-5ae3-4b12-85c2-0f224306cfbf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:51.497505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:51.498264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.498427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.498685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.509175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:51.513168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:51.514239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:51.515146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:51.515962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 105/213] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:51.524315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:51.531386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:51.639989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401fb7-09c6-4335-a6ef-baddeeae3425 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:51.657934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc80e4-c35b-4281-9972-b59762a8a9ab None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:51.686654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:51.687438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.687713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.687981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.689110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:51.690599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6515-69e5-4c5c-9f1b-98f768bc4491 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:51.692332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 109/214] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:51.693418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab467b-1f3c-4f69-b21e-da90ab0bef64 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.693695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab467b-1f3c-4f69-b21e-da90ab0bef64 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.693974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab467b-1f3c-4f69-b21e-da90ab0bef64 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.695278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 110/215] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:51.697518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab467b-1f3c-4f69-b21e-da90ab0bef64 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:51.698442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:51.699041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.699309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.699568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.700634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:51.700931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:51.702522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c59eb5-2e22-4e9d-a476-11784ca92359 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:51.706643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:51.715281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 106/216] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:51.716993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be03a-55b7-4f66-acfd-9ec0eef9f975 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.717285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be03a-55b7-4f66-acfd-9ec0eef9f975 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.717554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be03a-55b7-4f66-acfd-9ec0eef9f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.736615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c86be03a-55b7-4f66-acfd-9ec0eef9f975 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:51.738099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c86be03a-55b7-4f66-acfd-9ec0eef9f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:51.784894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:51.805782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 107/217] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:51.807045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9584-698e-49d6-8ea6-dff4ce3070fa None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.807335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9584-698e-49d6-8ea6-dff4ce3070fa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.807606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9584-698e-49d6-8ea6-dff4ce3070fa None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.808842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 108/218] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:51.809530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9584-698e-49d6-8ea6-dff4ce3070fa None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:51.815069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab467b-1f3c-4f69-b21e-da90ab0bef64 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:51.852155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:51.852439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.852717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.852987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.853624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:51.855097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0892-5df8-43ee-90ab-914f50e58dfe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:51.890093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 111/219] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:51 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:51.890093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.890093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.890093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:51.918950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:51.920765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:51.935542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9584-698e-49d6-8ea6-dff4ce3070fa None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:51.985741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:51.995310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:51.996667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:51.997134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:51.997935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] PATH_INFO: `/v3/users/7c876992c18e403c96f33ff8933e4b6b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.018862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] RBAC: Authorizing `identity:get_user(user_id=7c876992c18e403c96f33ff8933e4b6b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.021201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.024626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 109/220] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:51 2022] GET /identity/v3/users/7c876992c18e403c96f33ff8933e4b6b => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.029633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.032608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 112/221] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:52.079487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.144340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b09bb6-a3b4-4fdd-b169-68ff239baa56 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.148625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.186663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.187282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.187561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.187835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.191337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e725a8-6874-4688-97a4-82ce09c6d4e6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.238310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.239293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.240267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.240785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.258696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:52.261357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:52.264324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:52.265215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:52.266083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:52.267733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 113/222] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:13:52.272536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.278344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.279808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.387803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792ae67-2457-4fb3-b9d2-afe86f67845a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.414316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.417221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 110/223] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:13:52.418290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.429993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.430671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.431357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.431653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.432617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:52.432919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.434619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.447267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 114/224] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:52.448104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.516992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.533742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a5395-6e88-458f-8515-e2efd95e8175 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.570231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.570859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.571132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.571396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.582342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:52.586204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ca016-e908-456b-8ca9-6a63ebc6a2ac None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:52.587201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:52.588079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:52.588881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 111/225] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:52.590122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.633852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.634986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.635264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.635534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.637451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.639333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.641899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 115/226] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.643081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.696801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05e2f-f3d6-4067-8b6b-8ad768942d7b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.716293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.735769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.736575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.737167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.737490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.738725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.740578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.742428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 112/227] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.747578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.764753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.776503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83dcea-d72d-4516-863e-5ff0691069c2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.812879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.814096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.814375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.814642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.815409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:52.815715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.817202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.826179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 116/228] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.826998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.857518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0baad9-e828-4a5e-824a-02cf6b53232e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.894657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.895281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.895553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.895820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.896532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=7c876992c18e403c96f33ff8933e4b6b) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:52.896835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.898504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.904489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 113/229] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/role_assignments?user.id=7c876992c18e403c96f33ff8933e4b6b&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=9e04db42a455473b8b84df28c1a357fc => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.905396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.936751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105da3a-720d-4547-bdd5-a1b79e15e3b6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:52.952187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:52.975691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:52.976328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:52.976605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:52.976875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:52.978115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:52.979716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:52.981425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 117/230] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:52.988548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:52.996844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:53.021803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2903f-f5d9-42b8-a0ae-43ca9323458d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:53.060254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:53.060903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:53.061181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:53.061437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:53.062804 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:53.066042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:53.066374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 114/231] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:52 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:53.075973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:53.148672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d4594-f3dc-4b9e-824b-c7bdb905c5a1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:53.201077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:53.201753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:53.203674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:53.204440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/users/27861b6659c14bd48cd9577a265252ee/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:53.209185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, user_id=27861b6659c14bd48cd9577a265252ee, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:53.212940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:53.235326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c40b2-9d4c-4cb8-b88d-9498f60b8048 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:53.243651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 118/232] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:52 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/users/27861b6659c14bd48cd9577a265252ee/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:13:53.281820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:53.283342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:53.283757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:53.284164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:53.285619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:53.287398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9821ca9-2955-483c-9de0-68d20ee8b2f8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:53.289435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 115/233] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:53 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:53.295348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:53.364586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:53.455157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f973cae-9896-4802-8b2c-cc8941688939 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:53.499490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:53.500529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:53.501038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:53.501530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/users/27861b6659c14bd48cd9577a265252ee/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:53.505887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, user_id=27861b6659c14bd48cd9577a265252ee, role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:53.507639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb293-3bf2-49d5-9fd9-4f39dc2c0ac2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:53.527453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 119/234] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:53 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/users/27861b6659c14bd48cd9577a265252ee/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:54.336638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f1b1-b417-4bf2-a04f-1c13d26ea048 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:54.337175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f1b1-b417-4bf2-a04f-1c13d26ea048 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:54.337175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4f1b1-b417-4bf2-a04f-1c13d26ea048 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:54.338653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 116/235] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:54.343837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:54.344243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:54.344951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:54.385179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:54.386252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073ad50-ce20-4637-b68c-8c36fb431940 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:54.386433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:54.386890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073ad50-ce20-4637-b68c-8c36fb431940 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:54.387383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073ad50-ce20-4637-b68c-8c36fb431940 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:54.390157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 117/236] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:54.394304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:54.394794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:54.395258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:54.425260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:54.426490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:54.458292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:54.499529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 120/237] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:54.521799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 118/238] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:54.837561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:54.872560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:54.915542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:54.980621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd67470-a9c9-45e1-aa4b-1186e2564b12 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.020330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.021508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.021796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.022105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.036177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:55.041379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:55.042307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:55.043664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 121/239] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:55.049613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.140250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726bba7-bbad-4828-975e-b2544f27da3b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.174799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.175758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.176279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.176815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.177538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.179159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:55.180835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36415373-5401-4ce5-a489-70a5a7cd726e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:55.183203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 119/240] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:55.185298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9a16-74df-4d03-b5c5-68057aff96c9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.185774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9a16-74df-4d03-b5c5-68057aff96c9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.186254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f9a16-74df-4d03-b5c5-68057aff96c9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.187613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d9961-edf7-4b2e-b636-7b693864d674 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.188583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 120/241] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:55.189673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f9a16-74df-4d03-b5c5-68057aff96c9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.232388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.233004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.233280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.233551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.234250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:55.234552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:55.236442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367549e4-6840-476f-abee-399c6e76dcd7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:55.246354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.247862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 122/242] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:55.249075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.249351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.249624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.274298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:55.275510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:55.300260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f9a16-74df-4d03-b5c5-68057aff96c9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.337681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.339233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.339715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.340243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.341078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:55.342888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:55.346364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 123/243] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:55.347216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.380364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 121/244] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:55 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:55.450421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.461168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92798a-9f83-456f-b569-9e6e895f8dc6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.499350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.500009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.500288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.500621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] PATH_INFO: `/v3/users/25d0929503014544a0fb0edaad604dd4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.516011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=25d0929503014544a0fb0edaad604dd4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:55.517518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:55.519287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 124/245] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:55 2022] GET /identity/v3/users/25d0929503014544a0fb0edaad604dd4 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:55.525096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.597582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.621432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.661920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e1e1e-9d81-4ea4-b179-321f754e13ae None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.701432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.701998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.702288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.702564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.776171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62d930-86ae-40a2-bc97-1a4290db4ce2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:55.795363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:55.795363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2de95-eac8-4055-b626-3c467fd2c1f9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:55.823776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:55.824409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.824684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.824952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.840520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-44ae542e-69ca-496b-80d9-5ef27ff4ed9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:55.845920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:55.846818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 125/246] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:55.848249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798127-11e9-4357-9e9e-b80721905949 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.849004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798127-11e9-4357-9e9e-b80721905949 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.849004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53798127-11e9-4357-9e9e-b80721905949 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.850942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 126/247] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:55.852764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53798127-11e9-4357-9e9e-b80721905949 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:55.856800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.880955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:55.927590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 122/248] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:55.929473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:55.929759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:55.930107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:55.950118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:55.951420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:55.995062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53798127-11e9-4357-9e9e-b80721905949 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.042363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 123/249] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:56.043038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.051861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.052705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.052978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.053246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.053919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:56.054243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.055621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3567da-0062-4d67-b2b5-0c9dec424e6f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.074194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 127/250] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:56.075980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed48ed-16d6-41f9-9e98-ae03da48f2d9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.076505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed48ed-16d6-41f9-9e98-ae03da48f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.076975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed48ed-16d6-41f9-9e98-ae03da48f2d9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.078475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 128/251] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:56.084988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.085589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.086094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.107326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:56.108796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:56.176938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:56.185551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc8161-d626-450c-8286-f3978ff05048 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.215360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:56.242074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 129/252] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:56.243245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.256612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.257553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.258512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.259518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.262023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.267331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.274425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 124/253] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:56.291978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.395309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85c82-e00d-4da3-99c9-c069a59c590f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.419695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3244e5-2dde-473b-8f4d-dba7bc49c2e4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.431901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.432779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.433235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.433671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] PATH_INFO: `/v3/users/7c876992c18e403c96f33ff8933e4b6b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.435131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] RBAC: Authorizing `identity:get_user(user_id=7c876992c18e403c96f33ff8933e4b6b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.436830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.438649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 130/254] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/users/7c876992c18e403c96f33ff8933e4b6b => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:56.439695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.464128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.464725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.464969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.465288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.466041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=25d0929503014544a0fb0edaad604dd4) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:56.466352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.467994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.480806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 125/255] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/role_assignments?user.id=25d0929503014544a0fb0edaad604dd4&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=39b78c9526634786853a4e1eff655d03 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:56.481649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.508467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:56.545608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:56.555538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7582346-2ee9-47d2-b8c6-17a54b8f0c8b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.593036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.594178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.594706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.595170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.607013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:56.612970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:56.613880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:13:56.614741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:56.620853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 131/256] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:56.624283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.688698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4dcf-9a5a-4cff-9879-02c661d1123f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.746951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd06e9-d6a9-4a05-a3f7-212f8de3d576 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.773488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.774029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:56.774149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.774349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.774731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.776132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.778875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.787343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 126/257] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:56.788530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.790829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.793016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.793468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.793915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.795383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:56.798146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.803027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:56.818394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 132/258] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:56.823183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:56.938076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735417f5-8c8b-4ef8-aa3a-25878b951900 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:56.977779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:56.979258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:56.979729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:56.980343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/users/7c876992c18e403c96f33ff8933e4b6b/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:56.982476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, user_id=7c876992c18e403c96f33ff8933e4b6b, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:56.984136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:57.006824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 133/259] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:13:56 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/users/7c876992c18e403c96f33ff8933e4b6b/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:13:57.011160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.034994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.042018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aa382-8379-420f-8e95-8122ca9a24b6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.080608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.090035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.091242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.093342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.095194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.116653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:57.121914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:57.122825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:13:57.123715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:13:57.129597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 127/260] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:13:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:57.135456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.156654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447177b-7506-425f-8887-56dee361d6d7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.203281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.204539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.204818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.205085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.206327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:57.207797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:57.209444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 134/261] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:57.215626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.268692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c2f24-8fb4-470a-8cb7-d6f9ffe4411f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.312118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.312655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.312933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.314030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.314706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:57.315003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:57.316416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:57.331738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 128/262] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:57.337482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.373201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.395953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b48e45-4fd8-4832-96d5-3e3748fb7df9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.413415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.439721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.440344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.440623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.440895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.506983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffab03-31bc-444d-97d9-9bda228783cd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.529586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:57.531256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:57.541200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.541854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.542161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.542434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] PATH_INFO: `/v3/users/27861b6659c14bd48cd9577a265252ee` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.543569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] RBAC: Authorizing `identity:get_user(user_id=27861b6659c14bd48cd9577a265252ee)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:57.545032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:57.546961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 129/263] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/users/27861b6659c14bd48cd9577a265252ee => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:57.553043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.683665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.700875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc1c98-044d-458d-9760-5af69dc665a1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:57.771471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:57.772526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:57.772791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:57.773215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:57.792550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 135/264] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:57.798359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:57.829244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:57.917917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:57.919452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:58.045990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fdff2-422e-4e3c-8ddf-a1b0e5fec2aa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:58.074293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:58.080961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 130/265] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:13:58.087133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:58.112339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:58.112979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.113252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.113518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.118645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:58.120098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:58.122112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 136/266] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:57 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:58.127804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:58.264114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2bfbe-d96a-48d4-bd20-4060e2c15afd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:58.295409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:58.323555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ee559-b9f4-47e7-8f7f-ce97bbc3187f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:58.326824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:58.327461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.327739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.328004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.329906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:58.331393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3da0-b0f1-44d3-ae76-380864e07b0d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:58.342212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 131/267] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:13:58 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:58.343480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2835b1-f783-4792-99de-de3b6bfcf99b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.343758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2835b1-f783-4792-99de-de3b6bfcf99b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.344027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2835b1-f783-4792-99de-de3b6bfcf99b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.352571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 132/268] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:58.353229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2835b1-f783-4792-99de-de3b6bfcf99b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:58.400273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:58.400975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.401156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.401426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.402181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=27861b6659c14bd48cd9577a265252ee) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:58.402486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:58.403936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf2e05-e840-46d9-a917-ff38ecb847c6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:58.415016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 137/269] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:58 2022] GET /identity/v3/role_assignments?user.id=27861b6659c14bd48cd9577a265252ee&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:58.416052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0340-a52b-478b-905d-d22b25b2766f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.416331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0340-a52b-478b-905d-d22b25b2766f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.416599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0340-a52b-478b-905d-d22b25b2766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.459606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2edd0340-a52b-478b-905d-d22b25b2766f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:58.460830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2edd0340-a52b-478b-905d-d22b25b2766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:58.483670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:58.573737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2835b1-f783-4792-99de-de3b6bfcf99b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:58.585735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 138/270] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:58.628784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:58.629402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.629690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.629968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.630691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=27861b6659c14bd48cd9577a265252ee) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:58.630993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:58.632430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826e023-9f24-4d48-acff-05934e8a0440 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:58.642827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 133/271] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:13:58 2022] GET /identity/v3/role_assignments?user.id=27861b6659c14bd48cd9577a265252ee&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:58.814058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bab0-0f58-4ffc-9ad3-9db1528064ce None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.814428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bab0-0f58-4ffc-9ad3-9db1528064ce None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.814606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7bab0-0f58-4ffc-9ad3-9db1528064ce None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.816026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 139/272] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:58.822566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca1b9-791a-4559-ad8c-4a83652e21a2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.822850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca1b9-791a-4559-ad8c-4a83652e21a2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.823122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca1b9-791a-4559-ad8c-4a83652e21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.847736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2f1ca1b9-791a-4559-ad8c-4a83652e21a2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:58.848860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2f1ca1b9-791a-4559-ad8c-4a83652e21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:58.933576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dca-69b5-4db1-b5f9-618bb8910438 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.933904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dca-69b5-4db1-b5f9-618bb8910438 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.934137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57dca-69b5-4db1-b5f9-618bb8910438 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.935797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 140/273] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:58.941214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec57dca-69b5-4db1-b5f9-618bb8910438 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:58.944336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 134/274] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:58.945455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:58.945740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:58.946031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:58.971978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:58.973169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:59.031642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.060885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.071965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec57dca-69b5-4db1-b5f9-618bb8910438 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.086192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 135/275] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:13:59.109068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.110096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.110567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.111032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.121711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:59.127321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:59.128196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:13:59.129010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:59.131249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 141/276] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:59.137139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.248198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456e0c8-ceed-4c94-a3bf-512014d7210a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.255190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.290092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.290705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.290981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.291248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.291929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:59.292215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.293691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.304750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 136/277] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:59.309869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.359253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.404624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cece7-b831-4ed9-8d10-fa0868056662 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.430566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7ff1d-905e-4aa0-88e2-3777cf2ff99e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.442600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.443343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.443625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.443891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.444993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.446489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.448219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 142/278] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:59.448811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.451427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.465996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.466617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.466888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.467157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] PATH_INFO: `/v3/users/0270202181d74ce6856d9e00b3a397c2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.481281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] RBAC: Authorizing `identity:get_user(user_id=0270202181d74ce6856d9e00b3a397c2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.482759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.484553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 137/279] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/users/0270202181d74ce6856d9e00b3a397c2 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:13:59.485729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.570881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc8dc-872d-48ff-9e8c-b04ec1ebf59b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.587410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.590341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675baa8-41fe-48d5-ab0e-1748e24692d9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.612537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.613089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.613371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.613638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.624300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:13:59.627629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.628223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.628485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.628750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.629385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:13:59.630417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:13:59.631298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:13:59.632115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:13:59.632713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.632787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 143/280] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:13:59.632787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.666347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 138/281] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:13:59 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:13:59.667163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.709897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.760608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9df456-61a7-4a9c-831c-edf6f0ada0bf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.798924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a7cba-f548-4798-acc6-54ee5f434028 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:13:59.810666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.811091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.811422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.811696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.813622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, user.id=0270202181d74ce6856d9e00b3a397c2, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:59.813933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.815400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9361d3-7cce-404c-9027-3b1599d87a96 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.821535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 144/282] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/role_assignments?user.id=0270202181d74ce6856d9e00b3a397c2&scope.system=all&role.id=9e04db42a455473b8b84df28c1a357fc => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:59.822567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da73b-17c6-4c40-80b5-cc5cf3b762ff None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.822847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da73b-17c6-4c40-80b5-cc5cf3b762ff None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.823211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1da73b-17c6-4c40-80b5-cc5cf3b762ff None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.824559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 145/283] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:13:59.830632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.830911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.831182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.842076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:13:59.844114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:13:59.844114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:13:59.844114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:13:59.844114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:13:59.844467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:13:59.846468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:13:59.854945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:13:59.854945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:13:59.856599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 139/284] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:13:59.866215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:13:59.891099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:13:59.956430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 146/285] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:13:59.999684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0c863-57e0-4d0b-8c1a-611018bfbe01 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.035344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.035971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.036245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.036513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] PATH_INFO: `/v3/users/25d0929503014544a0fb0edaad604dd4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.037724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=25d0929503014544a0fb0edaad604dd4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:00.041414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:00.041414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 140/286] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:13:59 2022] GET /identity/v3/users/25d0929503014544a0fb0edaad604dd4 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:00.046603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.113279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:00.159713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879bb7d-d225-495f-94b7-19e254db05fc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.210971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.211608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.211885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.212153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.213272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:00.214737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:00.216736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 147/287] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:00 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:00.226978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.331810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:00.347515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d47c5-33f0-45ac-be81-f61e856a0eb2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.373915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.383288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.383961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.384286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.384567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/users/25d0929503014544a0fb0edaad604dd4/roles/39b78c9526634786853a4e1eff655d03` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.393120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, user_id=25d0929503014544a0fb0edaad604dd4, role_id=39b78c9526634786853a4e1eff655d03)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:00.395103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:00.418171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 141/288] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:00 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/users/25d0929503014544a0fb0edaad604dd4/roles/39b78c9526634786853a4e1eff655d03 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:00.525170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae19c4e-09b6-4e19-a8a1-6609d9290994 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.559880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:00.573900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.574440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.574718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.574991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.588666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:00.593938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:00.595375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:00.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 148/289] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:00.601810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.753295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbe7fd-77fd-414b-9d46-bfe5a57ddbfd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.797587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.798219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.798497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.798766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.799426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:00.799724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:00.801084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:00.813416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 142/290] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:00.818857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.938900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f670417-d876-4990-8fb9-bc1e975520b0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:00.982141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:00.982776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:00.983052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:00.983320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] PATH_INFO: `/v3/users/7c876992c18e403c96f33ff8933e4b6b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:00.984443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] RBAC: Authorizing `identity:get_user(user_id=7c876992c18e403c96f33ff8933e4b6b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:00.985928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:00.993472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:00.994174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 149/291] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:00 2022] GET /identity/v3/users/7c876992c18e403c96f33ff8933e4b6b => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:01.006614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:01.129916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3df7e-1556-4c50-a6e1-ee083e546524 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:01.166517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:01.167464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:01.167927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:01.168374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:01.239538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:01.241385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:01.253226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:01.381689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 143/292] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:01.386943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:01.469686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:01.534076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60fb8c-6e74-4840-8ee5-3926388ae711 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:01.578669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:01.579304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:01.579584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:01.579856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:01.580998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:01.582471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ff0dd-8745-4c1b-ac13-f49ce9408e06 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:01.584417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 150/293] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:01 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:01.590356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:01.740046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161898-663f-40be-b30d-70a73b9ca6f9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:01.751043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:01.778798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:01.779719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:01.780167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:01.780602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:01.781526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=7c876992c18e403c96f33ff8933e4b6b) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:01.782023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:01.783622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40155d1-657f-4409-9083-4ba53ad5c874 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:01.790368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 144/294] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:01 2022] GET /identity/v3/role_assignments?user.id=7c876992c18e403c96f33ff8933e4b6b&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=9e04db42a455473b8b84df28c1a357fc => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:02.053460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835da5-21c9-4fb7-af3a-122c8b824a0b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.054046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835da5-21c9-4fb7-af3a-122c8b824a0b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.054499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb835da5-21c9-4fb7-af3a-122c8b824a0b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.056028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 151/295] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:02.061699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4714b-825d-4617-88d3-ff958c47bdde None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.062011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4714b-825d-4617-88d3-ff958c47bdde None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.062278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4714b-825d-4617-88d3-ff958c47bdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.082086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7fd4714b-825d-4617-88d3-ff958c47bdde None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:02.083274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7fd4714b-825d-4617-88d3-ff958c47bdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:02.168123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 145/296] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:02.206045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d27a2-a583-4740-a37a-4964cb1ad48e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.206361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d27a2-a583-4740-a37a-4964cb1ad48e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.206587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d27a2-a583-4740-a37a-4964cb1ad48e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.208173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 152/297] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:02.214064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3cdd-3dbf-4bcb-b739-9bd0f4cab761 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.214633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3cdd-3dbf-4bcb-b739-9bd0f4cab761 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.215103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba3cdd-3dbf-4bcb-b739-9bd0f4cab761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.236427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b0ba3cdd-3dbf-4bcb-b739-9bd0f4cab761 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:02.238229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b0ba3cdd-3dbf-4bcb-b739-9bd0f4cab761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:02.318945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 146/298] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:02.442347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d27a2-a583-4740-a37a-4964cb1ad48e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:02.541919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ecc6-84a4-4f34-9954-759fe32b476c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.542564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ecc6-84a4-4f34-9954-759fe32b476c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.543029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ecc6-84a4-4f34-9954-759fe32b476c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.544549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 147/299] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:02.552603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.553167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.553596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d27a2-a583-4740-a37a-4964cb1ad48e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:02.554192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.576343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:02.580988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:02.583092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:02.592180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:02.592877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.593302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.593728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.605475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:02.611028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:02.612291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:02.613206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:02.615081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 153/300] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:02.615187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:02.616078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:02.666020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 148/301] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:02.666020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:02.752533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a9f52-5add-4a47-94f0-59b869d4590d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:02.770459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a61e41-2ca8-4909-a2ef-c6cbf3f4410d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:02.798736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:02.799365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.799636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.799958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.800985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:02.802457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b266577-e351-4fcd-afd4-a9bc0e696b6b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:02.806075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 154/302] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:02.806075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586cfdc-6432-436f-b497-34e718cca84c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.806075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586cfdc-6432-436f-b497-34e718cca84c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.806075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586cfdc-6432-436f-b497-34e718cca84c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.806795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 155/303] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:02.809189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586cfdc-6432-436f-b497-34e718cca84c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:02.809792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:02.810564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.810975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.811378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.812194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:02.812626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:02.814296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe3fb-3edc-4fb7-a074-bbfffbeba436 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:02.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 149/304] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:02.824183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.824466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.824731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.842834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:02.843922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:02.863280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:02.867324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:02.916531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 150/305] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:02.923341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586cfdc-6432-436f-b497-34e718cca84c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:02.923797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:02.959354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341a200-c053-41cb-9935-111e067e944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:02.960253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a200-c053-41cb-9935-111e067e944e None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:02.960540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a200-c053-41cb-9935-111e067e944e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:02.960811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a200-c053-41cb-9935-111e067e944e None admin] PATH_INFO: `/v3/groups` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:02.961435 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341a200-c053-41cb-9935-111e067e944e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:02.962939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341a200-c053-41cb-9935-111e067e944e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:02.979249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 156/306] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Aug 17 07:14:02 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:02.980346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341a200-c053-41cb-9935-111e067e944e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.061372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca15dd-8e4d-45b4-ae95-4e3be861c193 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.101694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.102285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.102557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.102824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] PATH_INFO: `/v3/users/0270202181d74ce6856d9e00b3a397c2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.104063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] RBAC: Authorizing `identity:get_user(user_id=0270202181d74ce6856d9e00b3a397c2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.105676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.107459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 151/307] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:02 2022] GET /identity/v3/users/0270202181d74ce6856d9e00b3a397c2 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:03.114106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.116698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341a200-c053-41cb-9935-111e067e944e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.128973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.143612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.167803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.168478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.168755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.169025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.182949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:03.188982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:03.189877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:03.190710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:03.191532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 157/308] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:03.196436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.235198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7def6-4fb1-47d9-9f84-e92d861482f0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.273039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.273686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.274005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.274275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] PATH_INFO: `/v3/system/users/0270202181d74ce6856d9e00b3a397c2/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.275701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0270202181d74ce6856d9e00b3a397c2, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.277075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.287312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 152/309] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Aug 17 07:14:03 2022] PUT /identity/v3/system/users/0270202181d74ce6856d9e00b3a397c2/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:03.298964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.312751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099200e8-8e87-44b1-bd10-ab331f513c2b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.362560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.363485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.363949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.364418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.371558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:03.372166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.374105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.385497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 158/310] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:03.392196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.413597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.432277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7b9d-4be1-412b-84fb-5cffcafff7b1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.434719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.476704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.477845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.478371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.478799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.495277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:03.503403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:03.504303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:03.505104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 153/311] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:03.514142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.522989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cadd7-c9ee-4fda-8fa3-cdff66d5a198 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.557559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.559030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.559526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.559982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] PATH_INFO: `/v3/users/75c2a32a726a4be4ada382a7311d54c1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.576623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] RBAC: Authorizing `identity:get_user(user_id=75c2a32a726a4be4ada382a7311d54c1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.578358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.580582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 159/312] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/users/75c2a32a726a4be4ada382a7311d54c1 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:03.586524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.639122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268589b-aae0-4489-ac6d-8b299454e338 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.682956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.686022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.687690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.689214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.689677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.690719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:03.691448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.693395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.696836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819f0b1-9906-4f07-8b19-01cf40746d4a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.704954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 154/313] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:03.710957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.724317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:03.745444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.746483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.746883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.747253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.748695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, user.id=75c2a32a726a4be4ada382a7311d54c1, scope.system=all) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:03.749175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.752003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.758898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 160/314] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/role_assignments?user.id=75c2a32a726a4be4ada382a7311d54c1&scope.system=all&role.id=39b78c9526634786853a4e1eff655d03 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:03.832766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa410097-ca9f-4956-8fd6-e0cbc5890ef8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:03.876110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:03.876757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:03.877032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:03.877301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] PATH_INFO: `/v3/users/25d0929503014544a0fb0edaad604dd4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:03.878478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] RBAC: Authorizing `identity:get_user(user_id=25d0929503014544a0fb0edaad604dd4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:03.879922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:03.881863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 155/315] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/users/25d0929503014544a0fb0edaad604dd4 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:03.887221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:03.996034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1695f0-3cb5-4983-9db3-0bba0eccaba9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:04.030314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:04.030922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:04.031198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:04.031463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:04.054357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:04.102759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:04.104669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:04.207659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 161/316] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:04.213172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:04.292091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:04.315502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cef43e-d84c-4fb8-a5d2-9bd0c9b2cf04 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:04.354420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:04.355058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:04.355340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:04.355610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:04.356716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:04.358171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250679ef-a05e-4277-b1b1-62b5a40fa6df None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:04.360711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 156/317] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:04 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:04.366432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:04.419936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:04.471096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81baebb-1bcc-4f60-9286-417fe5ca708d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:04.505506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:04.506137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:04.506413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:04.506679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:04.507404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, scope.project.id=1a078b8d31a94f60b425293e30917521, user.id=25d0929503014544a0fb0edaad604dd4) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:04.507704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:04.509141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5370f40-bf9a-4710-b454-fd40b6d590b2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:04.515340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 162/318] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:04 2022] GET /identity/v3/role_assignments?user.id=25d0929503014544a0fb0edaad604dd4&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=39b78c9526634786853a4e1eff655d03 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:04.999724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a771-47d0-43fd-947f-65f0bbf941f3 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.000231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a771-47d0-43fd-947f-65f0bbf941f3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.000817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a771-47d0-43fd-947f-65f0bbf941f3 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.002353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 157/319] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:05.007321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3df19-2885-4dd5-a36e-c68dca975928 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.007710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3df19-2885-4dd5-a36e-c68dca975928 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.007867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3df19-2885-4dd5-a36e-c68dca975928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.026225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d7c3df19-2885-4dd5-a36e-c68dca975928 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:05.027398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d7c3df19-2885-4dd5-a36e-c68dca975928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:05.093996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 163/320] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:05.276105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d82bf-d71e-48e4-8219-aaf77a7b407b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.276431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d82bf-d71e-48e4-8219-aaf77a7b407b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.276602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d82bf-d71e-48e4-8219-aaf77a7b407b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.278047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 158/321] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:05.282911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.283195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.283461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.301818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:05.303019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:05.343675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:05.358931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d82bf-d71e-48e4-8219-aaf77a7b407b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:05.374368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 164/322] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:05.466561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d82bf-d71e-48e4-8219-aaf77a7b407b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:05.502200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:05.503080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.503528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.503963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.505205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:05.507131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:05.509166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 159/323] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:05.514374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:05.615480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0f2e-f7eb-4e0a-b107-924f8213962e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:05.642749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:05.650360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:05.650973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.651331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.652026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] PATH_INFO: `/v3/groups` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.652666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:05.654558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459b0d1-1eae-47e3-aeea-ce7370f58bfe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:05.658339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:05.670995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 165/324] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Aug 17 07:14:05 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:05.696543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662390-96f1-4ddb-9b8d-2bb7fd21db1f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.696923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662390-96f1-4ddb-9b8d-2bb7fd21db1f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.697085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54662390-96f1-4ddb-9b8d-2bb7fd21db1f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.698706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 166/325] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:05.704623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.704922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.705159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.725749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:05.727006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:05.759880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:05.764834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7a35-79eb-4319-a895-864461c502b0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:05.802111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:05.803139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.803515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.803792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.815541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:05.815979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 167/326] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:05.821182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:05.822102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:05.822925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 160/327] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:05.827985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:05.939804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112387-d737-4077-a18a-6a9731687fe7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:05.976010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:05.976621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:05.976895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:05.977162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:05.977819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:05.978145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:05.979529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:05.988903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 168/328] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:05.994267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.081689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:06.099986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.138529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0150ecb-337f-4d86-a7fa-4b17cf1bf6ef None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.148612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:06.178525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.179669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.179958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.180241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] PATH_INFO: `/v3/users/0270202181d74ce6856d9e00b3a397c2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.181704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] RBAC: Authorizing `identity:get_user(user_id=0270202181d74ce6856d9e00b3a397c2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:06.183231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:06.187271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 161/329] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:05 2022] GET /identity/v3/users/0270202181d74ce6856d9e00b3a397c2 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:06.194070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.256591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89245ff8-936a-4b76-9a38-6bfecd2dc08a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.295320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.296025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.296448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.296836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.308197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:06.313906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:06.315806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:06.320514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 169/330] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:06.324915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.400333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9cc1b-056b-4aff-901a-0cfd3784e6ba None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.440409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:06.456737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc17a19-9022-4ea0-bb5f-c0fd2d47835f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.460363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.461056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.461400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.461732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.462615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] RBAC: Adding query filter params (role.id=9e04db42a455473b8b84df28c1a357fc, user.id=0270202181d74ce6856d9e00b3a397c2, scope.system=all) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:06.462985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:06.464613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:06.472376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:06.481528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 162/331] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 17 07:14:06 2022] GET /identity/v3/role_assignments?user.id=0270202181d74ce6856d9e00b3a397c2&scope.system=all&role.id=9e04db42a455473b8b84df28c1a357fc => generated 510 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:06.503843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.504474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.504745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.505012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.505692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:06.506023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:06.507418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:06.518836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 170/332] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:06.525386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.645486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdc019-4880-487f-9eff-96ec4e21b62b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.695689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.696366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.696635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.696906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] PATH_INFO: `/v3/users/75c2a32a726a4be4ada382a7311d54c1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.698075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] RBAC: Authorizing `identity:get_user(user_id=75c2a32a726a4be4ada382a7311d54c1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:06.699536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c027-1f79-4b72-bc30-3f139978cf51 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:06.701307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 163/333] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:06 2022] GET /identity/v3/users/75c2a32a726a4be4ada382a7311d54c1 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:06.707671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:06.820577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce136f60-1539-4aba-a52a-c08abac572de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:06.856182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:06.856832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:06.857107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:06.857371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] PATH_INFO: `/v3/system/users/75c2a32a726a4be4ada382a7311d54c1/roles/39b78c9526634786853a4e1eff655d03` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:06.858816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=75c2a32a726a4be4ada382a7311d54c1, role_id=39b78c9526634786853a4e1eff655d03)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:06.860241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872d82a-6cea-45ab-9aee-8b3487ad7139 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:06.871300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 171/334] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Aug 17 07:14:06 2022] PUT /identity/v3/system/users/75c2a32a726a4be4ada382a7311d54c1/roles/39b78c9526634786853a4e1eff655d03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:08.014099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2625b-8f4c-421f-8c33-47facb0b7459 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.014612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2625b-8f4c-421f-8c33-47facb0b7459 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.014689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2625b-8f4c-421f-8c33-47facb0b7459 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.016014 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 164/335] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:08.021373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.021769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.021953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.054976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:08.056184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:08.066476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:08.109019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef24261-ab2c-4dc7-ba1f-a1fc0587c5df None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.109450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef24261-ab2c-4dc7-ba1f-a1fc0587c5df None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.110412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef24261-ab2c-4dc7-ba1f-a1fc0587c5df None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.111848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 165/336] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:08.117450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.117734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.118029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.140014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 172/337] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:08.147765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:08.148982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:08.234847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:08.246031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 166/338] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:08.713599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:08.788764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:08.872447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879648-4b3f-4b11-a03e-dec7c3374b40 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:08.918042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:08.918680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.918951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.919274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.927092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610dbfd-9233-4a5e-8b5b-5afd1908ef5b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:08.935597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-539efb61-4684-4984-971f-00a2d1b61514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:08.940484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:08.941377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:08.942240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:08.946412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 173/339] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:08.947656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5d5-aa17-4a31-a960-d82c15acbfb3 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.947938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5d5-aa17-4a31-a960-d82c15acbfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.948205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ae5d5-aa17-4a31-a960-d82c15acbfb3 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.953239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 174/340] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:08.955114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.955586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.956023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:08.974360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:08.981404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:08.982621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:08.985744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:08.986409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:08.986689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:08.987215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.008300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:09.013055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:09.013939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:09.015196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:09.018146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 167/341] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:09.019527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.094995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:09.136267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 175/342] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:09.137118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.182572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba51d73-537c-4a39-9c66-c4409328344f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:09.227239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:09.227783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:09.228064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:09.228355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.229011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:09.229336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:09.230823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:09.244877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 168/343] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:09.252282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.286261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7a002-e847-43e2-bc97-5b919c57aae0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:09.331597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:09.332214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:09.332495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:09.332761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.333437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:09.333732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:09.335313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:09.337070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:09.346561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 176/344] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:09.356207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.509887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a742f-842c-47f1-8521-44738115f814 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:09.538277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6228b-1af6-41a7-9812-4e6394d5b9d5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:09.544889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:09.578954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:09.579573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:09.579847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:09.580111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.608344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:09.608966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:09.609304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:09.609696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.694353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:09.695889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:09.742334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:09.751759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:09.753254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e6ef0-e80b-4e47-9305-01d786fbd5bb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:09.855048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:14:09.856113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.879057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:09.883668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 177/346] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:14:09.885120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a084b5-c0be-4b45-b25f-81dcc52cac83 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:09.885548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a084b5-c0be-4b45-b25f-81dcc52cac83 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:09.890455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a084b5-c0be-4b45-b25f-81dcc52cac83 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:09.892250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 178/347] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:09.893175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a084b5-c0be-4b45-b25f-81dcc52cac83 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:09.973289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bffa2-cb87-4dca-98dc-03bbd105bbc2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.001661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.009257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a084b5-c0be-4b45-b25f-81dcc52cac83 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.015098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.016300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.016753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.017170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.028780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:10.033819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:10.035058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:10.036072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:10.038554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 170/348] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:10.039549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.055112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.055748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.056023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.056288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.057517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.059107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35eeb9-0953-4095-84d2-1331a7350e17 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.061109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 179/349] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:09 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.062410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.063255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.063535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.082442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:10.083640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:10.130184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.162587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646955-67a1-414a-b5cc-00be091a2bf9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.162770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 180/350] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:10.163664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.208321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.208964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.209239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.209920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.211772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.213485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.216118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 171/351] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.216971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.275466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.284373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390b7a1-9597-4149-9147-106d830b4cdd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.325385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.326052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.326333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.326601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.327271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:10.327571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.329123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfba03b-6585-4c68-9db9-9f092184c4a7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.339323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 181/352] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.340419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b5f88-689c-450e-bc35-7844cf0f7160 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.340700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b5f88-689c-450e-bc35-7844cf0f7160 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.340966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b5f88-689c-450e-bc35-7844cf0f7160 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.342210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 182/353] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:10.342893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b5f88-689c-450e-bc35-7844cf0f7160 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.375674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0a84d-b3f8-476b-9b71-6b43f0ebe78c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.421608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.422922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.423259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.423528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.431355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.432814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcbea6-9813-4538-920c-c7c460441904 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.434853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 172/354] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.437729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.438025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.438349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.462641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:10.463826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:10.467697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.472591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b5f88-689c-450e-bc35-7844cf0f7160 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.519785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.520419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.520693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.520963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.522309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.523562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.525153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 183/355] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.527004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.546202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 173/356] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:10.547371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.561284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.662344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03804aa-d2bd-4e56-be22-699704938108 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.696562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a914ee3-204a-411e-8048-b383e51264dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.700269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.700962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.701244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.701511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.738225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.738987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.739264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.740322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.741054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=19d5e4d06504401c9195a9ad55640c4b) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:10.741355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.742859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.749327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 174/357] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=9e04db42a455473b8b84df28c1a357fc => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:10.750717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.763182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.781183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:10.783635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7daf9-0c3f-47d8-84a6-65b609116a4c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:10.816325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:10.908033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1c348-6cc4-4757-99b7-eb1765a4980a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:10.919157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 184/358] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:10.922578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792e1f-12a0-4ddb-a2fe-5c6d692f39a6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.922578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792e1f-12a0-4ddb-a2fe-5c6d692f39a6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.922784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4792e1f-12a0-4ddb-a2fe-5c6d692f39a6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.929478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 185/359] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:10.929478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4792e1f-12a0-4ddb-a2fe-5c6d692f39a6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:10.953319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:10.954717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:10.955166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:10.956090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:10.970224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:10.976035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:10.976925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:10.977750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:10.979050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 175/360] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:10.979132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.055311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.058624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4792e1f-12a0-4ddb-a2fe-5c6d692f39a6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.089103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.105830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.106503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.106782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.107056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.107797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=19d5e4d06504401c9195a9ad55640c4b) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:11.108107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.108994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ba83-62ee-443f-b152-b3d32f8f1e64 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.109600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.118038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 186/361] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.123041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.156393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.157033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.157307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.157576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.169002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d699d05a-b2ae-48d6-8ff0-de8131e3d6a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:11.174480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:11.175464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:11.176295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 176/362] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:11.177076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.177436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.177603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.199120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:11.200328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:11.268975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb7bee-1e6b-4416-a0c7-10c11f2a142a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.294686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 177/363] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:11.295561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.308561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.309210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.309492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.309760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.311464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.313495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.315379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 187/364] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.315994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.367766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.386052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.426999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7680f-901d-4d76-8fcc-4dd7786f97f1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.437497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e2c3-469e-4296-9098-22d1f9f8e7f3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.489617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.490257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.490535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.490800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.491467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:11.491761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.493136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.498511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.499117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.499391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.499662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.500899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:11.501197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.502580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.513526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 178/365] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.514190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.519860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 188/366] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.520635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.688584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce706ce8-05bf-46b4-8a62-61b567bba82e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.689694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345279f7-1697-4d05-838d-c010884f5d02 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.706175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.710689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:11.730898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.731537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.731817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.732086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.733294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.735486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.737630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 179/367] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.739502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.741020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.741635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.741906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.742226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.838205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.839588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.884265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e330a-5d3f-4222-96fb-bc74dd5237ff None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:11.939057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:11.940102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:11.940389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:11.940675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] PATH_INFO: `/v3/users/75c2a32a726a4be4ada382a7311d54c1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:11.942375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] RBAC: Authorizing `identity:get_user(user_id=75c2a32a726a4be4ada382a7311d54c1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:11.944087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:11.947775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 180/368] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/users/75c2a32a726a4be4ada382a7311d54c1 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:11.948593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.974047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 189/369] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:11.974906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:11.997690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.008849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.075885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775475d-c093-43d0-a5e3-46a7f55ceb5f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.104244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089c5f8-5ac7-44f7-9c9e-f04b36eb7535 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.114253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.115160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.115658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.116189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.127859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:12.134793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:12.135677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:12.136482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:12.138845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 181/370] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:12.140066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.143625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.144349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.144683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.144953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.146507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=1a078b8d31a94f60b425293e30917521) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:12.146507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.147592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.154030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 190/371] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:11 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=9e04db42a455473b8b84df28c1a357fc => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:12.154707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.253135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.254748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49423885-1de0-4ee9-a256-9e9a77c1c3f3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.273994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.276661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf3127-1ad3-48f7-b8da-339b315870d4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.305176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.306094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.306602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.307009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.307972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] RBAC: Adding query filter params (role.id=39b78c9526634786853a4e1eff655d03, user.id=75c2a32a726a4be4ada382a7311d54c1, scope.system=all) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:12.308413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.314378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.318342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.318982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.319259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.319528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.320728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.322370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.324169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 191/372] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:12.329135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.338700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 182/373] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/role_assignments?user.id=75c2a32a726a4be4ada382a7311d54c1&scope.system=all&role.id=39b78c9526634786853a4e1eff655d03 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:12.339623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.495210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8e5bb-bb0b-4bd6-88d3-93d947c8307c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.508680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d301-e3ae-4d86-a95d-5c40e6730ef2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.561368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.563561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.564053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.564514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.565815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.567286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.567832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.567943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.568181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.568454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.569131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:12.569493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.571426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.571724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 183/374] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:12.576273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.582157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 192/375] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:12.588810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:12.618315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.647251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:12.754015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927a3f-243b-4581-9117-c3c7b1a63a7a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.794478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622ae6-49bb-41ff-8775-4f39a5cd14b9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:12.815495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.817455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.817800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.818162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.819021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=1a078b8d31a94f60b425293e30917521) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:12.819532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.821921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.833345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 184/376] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:12.853602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:12.854344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:12.854692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:12.855031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:12.945239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:12.946748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:12.962971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:13.068760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 193/377] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:14:13.074247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:13.197600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732a89-e734-4d3d-b0ab-f42931cc19e2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:13.199280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:13.240928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:13.241795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.242337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.242744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] PATH_INFO: `/v3/projects/93dca03ccb1d4c01b8cd3b051645d149` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.244008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] RBAC: Authorizing `identity:get_project(project_id=93dca03ccb1d4c01b8cd3b051645d149)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:13.245570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d2a53-9e5c-4318-bc40-a3f8495d73f5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:13.247721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 185/378] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:13 2022] GET /identity/v3/projects/93dca03ccb1d4c01b8cd3b051645d149 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:13.255295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:13.262546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d6f-88fd-4cc9-a88b-6f0191ee08ad None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.263006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d6f-88fd-4cc9-a88b-6f0191ee08ad None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.263415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d6f-88fd-4cc9-a88b-6f0191ee08ad None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.264857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 186/379] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:13.271521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.271802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.272069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.290625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:13.291812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:13.368812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 187/380] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:13.418455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a932-425b-452d-8602-1a245713a7fe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:13.434371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:13.462147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:13.462780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.463060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.463324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] PATH_INFO: `/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.470101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] RBAC: Authorizing `identity:get_group(group_id=a0cfcdf1f76d4f1991e2e8eb625bd16f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:13.471569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:13.478479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 194/381] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:13 2022] GET /identity/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:13.484524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:13.624139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:13.627593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334c14-7481-4a8f-9892-39df351e0bbe None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:13.671723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:13.672358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.672636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.672908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.673640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] RBAC: Adding query filter params (group.id=a0cfcdf1f76d4f1991e2e8eb625bd16f, role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=93dca03ccb1d4c01b8cd3b051645d149) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:13.673944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:13.675389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a740e-1bd3-43fd-9de7-c64f411c2835 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:13.684420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 188/382] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:13 2022] GET /identity/v3/role_assignments?group.id=a0cfcdf1f76d4f1991e2e8eb625bd16f&scope.project.id=93dca03ccb1d4c01b8cd3b051645d149&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:13.747109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:13.884069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8b1f-96c9-4d00-8d60-c1249fb63f96 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:13.902588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db464-d7e0-44f1-9e66-86c1f9a5d722 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.903149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db464-d7e0-44f1-9e66-86c1f9a5d722 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.903149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7db464-d7e0-44f1-9e66-86c1f9a5d722 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.904711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 189/383] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:13.910282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.910568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.910844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.925216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:13.926204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:13.926676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:13.927132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:13.945477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:13.946689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:13.950950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:13.956317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:13.957221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:13.958053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 195/384] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:13.963068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.029061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:14.056482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 190/385] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:14.112906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda51279-3c95-4513-aa88-f124ce368ee9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:14.155144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:14.155740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.156073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.156918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.157593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:14.157894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:14.159324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:14.168301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 196/386] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:14.174601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.318427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:14.326270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ec99c-3779-4b4f-89f5-bd39d6f98cdf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:14.367341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:14.367978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.368309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.368576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.369686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:14.371142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:14.372731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 191/387] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:14 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:14.378386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.508458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.533984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:14.538696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73567c5e-fd9b-4ff7-98c4-1f3abaf75284 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:14.584419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:14.585465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.586302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.586774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.589693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:14.591720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:14.596767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 197/388] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:14 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:14.602303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.701951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfc03d-df69-4657-b701-2c86c7e935c7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:14.725576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec4ba7-cafa-40b6-8001-93831735d937 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:14.766787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:14.767908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.768386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.768851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.792263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:14.796519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a167dcd2-e622-4899-a97b-0306b9e53cdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:14.797837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:14.798882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:14.799695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:14.800306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 192/389] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:14.801092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.801417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881bb3-542a-4d46-8e78-ab8f85f7f47d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.801698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881bb3-542a-4d46-8e78-ab8f85f7f47d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.801988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881bb3-542a-4d46-8e78-ab8f85f7f47d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.802201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.802676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/groups/56c98634dbe04864b28b255e9ffc9770/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.803205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 193/390] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:14.808331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, group_id=56c98634dbe04864b28b255e9ffc9770, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:14.809186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881bb3-542a-4d46-8e78-ab8f85f7f47d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:14.810784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbc50c-f41a-4325-b9ff-2447751f1131 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:14.838176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 198/391] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 17 07:14:14 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/groups/56c98634dbe04864b28b255e9ffc9770/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:14.839627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:14.839910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:14.840226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:14.842793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:14.875702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:14.879677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:14.920462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:15.011800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881bb3-542a-4d46-8e78-ab8f85f7f47d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.057743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.058408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.058682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.058949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.059628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:15.059922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:15.061322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:15.064630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 199/392] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:15.074704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 194/393] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:15.080686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.185620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47debe-5ed5-429d-936f-dae3d5aa270f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.224265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.224898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.225173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.225442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.226573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:15.228008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279782-adb9-404f-aef8-54896bd2b1e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:15.229878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 200/394] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:15.235411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.384579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:15.403754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91be45-c43d-4aae-892f-f225a4111302 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.420290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a37f4-f70a-4861-904c-c1a853d7586e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.420603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a37f4-f70a-4861-904c-c1a853d7586e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.420843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a37f4-f70a-4861-904c-c1a853d7586e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.422374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 201/395] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:15.427889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.428409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.428940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.457620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:15.457806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.458326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.458603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.458871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.459935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:15.462700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:15.464159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:15.469984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 195/396] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:15.484407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.485599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:15.549313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 202/397] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:15.565606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.673386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd1f95-e6a6-4453-bcf4-4b83cf1981ef None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.696325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860677fc-53f4-4797-8a87-3d3dae11be38 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.712470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.713414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.714002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.714495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.726847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:15.732210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:15.733079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:15.733887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:15.736726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 203/398] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:15.744852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.764427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:15.782468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.783424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.783845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.784258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b/groups/56c98634dbe04864b28b255e9ffc9770/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.786706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=19d5e4d06504401c9195a9ad55640c4b, group_id=56c98634dbe04864b28b255e9ffc9770, role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:15.793985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:15.821274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 196/399] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 17 07:14:15 2022] PUT /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b/groups/56c98634dbe04864b28b255e9ffc9770/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:14:15.874868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba500bc-f108-4e16-abf3-93666fe8b8bf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:15.884968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:15.915970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:15.942697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:15.943375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:15.943656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:15.943924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:15.944602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] RBAC: Adding query filter params (name=member) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:15.944902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:15.946334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:15.965824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 204/400] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:15.971180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.070538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.072920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93071ffd-811b-4a53-844c-f8c75d6892e9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.098852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68196a1-21e5-4377-a2a1-46ef1a02e15d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.115903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.116628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.116906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.117275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.128159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2e24f59f-ddd8-4bcb-b637-b2c781057493 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:16.134227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:16.135115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:16.136322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:16.136925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.136925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.136925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.137124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 197/401] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:16.137505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.137575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729894-b34e-4664-a95c-07ca72201c4e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.137575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729894-b34e-4664-a95c-07ca72201c4e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.137575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14729894-b34e-4664-a95c-07ca72201c4e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.139751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 198/402] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:16.141620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.143287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d17a3-d96b-4554-8f81-855ef9cb62ea None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.143484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14729894-b34e-4664-a95c-07ca72201c4e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.145277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 205/403] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:15 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:16.146575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.146852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.147925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.167430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:16.168629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:16.227011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.240638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:16.241635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.291937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14729894-b34e-4664-a95c-07ca72201c4e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.356372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.356986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.357262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.357532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.358219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:16.358516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.365599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.381018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.383186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 199/405] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:16.392741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.435941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babd470-1133-4c1a-9ddd-e52b81025fcc None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.475319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.475945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.481214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.481436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.482694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.484123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.486049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 207/406] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:16.491961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.588115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd11811-2419-4b54-8b18-3da29a11693a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.627956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.628583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.628849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.629115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.630305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.631785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.632266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3869dd-327c-4c37-9549-ac82bfd8980f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.633694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 200/407] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:16.634649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.637068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.671162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.672293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.672773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.673271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/groups/56c98634dbe04864b28b255e9ffc9770/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.675844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, group_id=56c98634dbe04864b28b255e9ffc9770, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.677529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.693439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 208/408] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 17 07:14:16 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/groups/56c98634dbe04864b28b255e9ffc9770/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:16.694704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.697649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.746996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7eaea-2d23-4ab5-874a-ad1679507c74 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.785927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.786592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.786867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.787135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.799575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:16.805947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:16.806904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:16.807822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 201/409] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:16.824000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.845149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59885-159c-42e6-a247-abcb5517edf7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:16.907802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:16.912831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:16.913724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:16.914223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:16.914688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:16.916853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:16.918600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:16.921661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 209/410] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:16.926948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:16.973015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729b634-6a3d-4ced-994b-096bff3b182e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:17.022883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:17.023785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.024423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.025646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.026517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:17.027249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:17.030158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:17.033211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:17.049742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 202/411] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:17.057816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:17.101431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede5e7e-2ffb-4617-95a1-c85ad1a0df50 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:17.170914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:17.172051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.172510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.172956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521/groups/56c98634dbe04864b28b255e9ffc9770/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.177448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] RBAC: Authorizing `identity:create_grant(project_id=1a078b8d31a94f60b425293e30917521, group_id=56c98634dbe04864b28b255e9ffc9770, role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:17.179443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:17.216280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 210/412] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 17 07:14:16 2022] PUT /identity/v3/projects/1a078b8d31a94f60b425293e30917521/groups/56c98634dbe04864b28b255e9ffc9770/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:17.252037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6808fdf-ff48-40a5-9277-571621772671 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:17.291147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:17.306820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:17.307470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.307747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.308017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] PATH_INFO: `/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.309290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] RBAC: Authorizing `identity:get_group(group_id=a0cfcdf1f76d4f1991e2e8eb625bd16f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:17.310893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441609c1-adc2-40fc-b41f-9c4319113d8c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:17.313506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 203/413] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:17 2022] GET /identity/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:17.319262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:17.355807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892353a0-1d39-46fd-845c-92e558c2f49a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.356328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892353a0-1d39-46fd-845c-92e558c2f49a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.356328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892353a0-1d39-46fd-845c-92e558c2f49a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.357822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 204/414] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:17.365345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.365680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.365956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.388226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:17.389418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:17.480270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5dd9-fd5c-4ce8-9dbc-b5d98424c18e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:17.490024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 205/415] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:17.552962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:17.575415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:17.576066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.576344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.576621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] PATH_INFO: `/v3/projects/93dca03ccb1d4c01b8cd3b051645d149` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.582990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] RBAC: Authorizing `identity:get_project(project_id=93dca03ccb1d4c01b8cd3b051645d149)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:17.584520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:17.586399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 211/416] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:17 2022] GET /identity/v3/projects/93dca03ccb1d4c01b8cd3b051645d149 => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:17.593191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:17.771786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67534b18-c19b-40d2-99de-05bcf03c9b51 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:17.796322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:17.809787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:17.810408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:17.810685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:17.810957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] PATH_INFO: `/v3/projects/93dca03ccb1d4c01b8cd3b051645d149/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:17.813896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] RBAC: Authorizing `identity:create_grant(project_id=93dca03ccb1d4c01b8cd3b051645d149, group_id=a0cfcdf1f76d4f1991e2e8eb625bd16f, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:17.815423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:17.831945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 206/417] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Aug 17 07:14:17 2022] PUT /identity/v3/projects/93dca03ccb1d4c01b8cd3b051645d149/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:14:17.949670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:18.134291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d2951-0af1-4d02-b0fc-c8d47f099a67 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:18.178723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:18.179685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.180139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.180594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.200961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-89690c71-481a-4214-9d84-97eaa90bf6de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:18.206248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:18.207141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:18.208029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:18.213304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:18.213492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 212/418] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:18.311106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b233-f30f-404a-94a6-b97dd32b6473 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.311480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b233-f30f-404a-94a6-b97dd32b6473 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.312165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332b233-f30f-404a-94a6-b97dd32b6473 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.314663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 213/419] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:18.321109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.321569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.321993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.334896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e51091-547a-41e6-9678-8b4b1c95975b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:18.356530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:18.357731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:18.403811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:18.404343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.404616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.404884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.405546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:18.405843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:18.407780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:18.428315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 207/420] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:18.431383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:18.495296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:18.495874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 214/421] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:18.508025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:18.580870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8e7d0-25ce-4d9b-8cfa-e78a90f6fe2f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:18.630090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:18.630771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.631057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.631328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.702494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:18.704502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:18.759716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:18.833407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 208/422] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:18.839140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:18.927170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:18.951401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b927c6-9567-4977-b8cb-638ae260a2aa None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:18.988216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:18.988767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:18.989213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:18.989487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:18.990793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:18.992298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:18.994362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 215/423] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:18 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:19.003833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.078778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.092695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e366a-40a0-4e3c-a2d7-fe0148b696e5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.132784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c5843-d7c1-4f24-9f53-824c2bc7586f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.134686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.135680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.136147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.136646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.148393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-48307f8b-edcb-4cbd-b699-4de73054835b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:19.153828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:19.154775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:19.155610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:19.158368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 209/424] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:19.160050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0167-22d9-4287-86f7-135b9bab8cd8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.160526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0167-22d9-4287-86f7-135b9bab8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.161005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0167-22d9-4287-86f7-135b9bab8cd8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.162679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 210/425] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:19.167439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0167-22d9-4287-86f7-135b9bab8cd8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.170710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.171346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.171624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.171935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.174228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:19.174360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.178693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251d370-9f8e-4530-98a0-673d7257a884 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:19.181136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 216/426] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:19.182661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.183157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.183621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.206487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:19.208027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:19.298062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 217/427] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:19.298062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.310628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0167-22d9-4287-86f7-135b9bab8cd8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.353163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.402896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6be5c9-c0c4-498c-bd77-b899b4fcbe18 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.431261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.432204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.432691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.433149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.434060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:19.434577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:19.436282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:19.440520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.440520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.440520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.440520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.441037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=19d5e4d06504401c9195a9ad55640c4b) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:19.441349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:19.443233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:19.449773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 218/428] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=9e04db42a455473b8b84df28c1a357fc => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:19.456326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 211/429] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:19.462071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.600720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941de6dd-0991-410a-8bc1-33c9daffeb89 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.628343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.632177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.641007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.641632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.641916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.642222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.721895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:19.723404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84a810-bb3e-4d75-97ad-57919621eed8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:19.785438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.828905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4cfc9-9435-4837-af78-b110f7b8b81d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:19.849550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 219/430] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:19.849550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55157-76dc-40ca-b91a-fa7b0778f8c2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.849550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55157-76dc-40ca-b91a-fa7b0778f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.849550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c55157-76dc-40ca-b91a-fa7b0778f8c2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.849550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 220/431] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:19.851101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55157-76dc-40ca-b91a-fa7b0778f8c2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:19.877588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:19.878249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.878523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.878795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.882104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:19.891909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b1a37dc6-23e8-4c8f-a1c0-734b92ba5670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:19.901495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:19.902965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 212/432] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:19.903792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:19.904521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:19.904521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:19.921657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:19.923525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:19.995293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c55157-76dc-40ca-b91a-fa7b0778f8c2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.011886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 213/433] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:20.012567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.054907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.055557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.055869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.056139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] PATH_INFO: `/v3/projects/19d5e4d06504401c9195a9ad55640c4b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.057258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] RBAC: Authorizing `identity:get_project(project_id=19d5e4d06504401c9195a9ad55640c4b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.058864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.060696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 221/434] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:19 2022] GET /identity/v3/projects/19d5e4d06504401c9195a9ad55640c4b => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:20.066035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.094129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.148807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940c724-084c-41a0-af39-3f0cfabeacd8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.169908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.184249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.184845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.185124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.185394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.186075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:20.186380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.187364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25208c-88b6-407a-9889-cc71c36bfdc3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.187763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9c7d2-7c7b-4a1c-bdef-1733f7a544c8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.198312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 214/435] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:20.204520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f164f9-7602-4cb5-952e-54d6faec21b0 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.205226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f164f9-7602-4cb5-952e-54d6faec21b0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.205650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f164f9-7602-4cb5-952e-54d6faec21b0 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.207689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 215/436] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:20.208522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f164f9-7602-4cb5-952e-54d6faec21b0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.224440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.225248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.225367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.225595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.226738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.228242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcd148-ef37-4421-86a8-d688b559a92f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.229880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 222/437] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:20.231009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.231272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.232776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.249195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:20.250412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:20.318843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 223/438] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:20.319684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.325174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f164f9-7602-4cb5-952e-54d6faec21b0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.346307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.364867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.366216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.366216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.368272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.409135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.426241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c49a2c-5015-4c87-9545-5f4e05c4fcb1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.441643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.443304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.460384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.460979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.461261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.461528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.462322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=19d5e4d06504401c9195a9ad55640c4b) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:20.462577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.463994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.471010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 224/439] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=19d5e4d06504401c9195a9ad55640c4b&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:20.475175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.557330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 216/440] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:20.563720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.589273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.630602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da9918-563d-410d-9a6f-67f273227dbb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.670197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.670783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.671487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.671487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.679986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93442f-95f8-47b0-a755-3572debf8142 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.682010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:20.687804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:20.688727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:20.689535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 225/441] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:20.690253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.702021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.727846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.728483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.728757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.729023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.730370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.732115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.733981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 217/442] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:20.734668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.811119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22a2f-0767-42f3-ab8d-0d6279da6fd1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.833361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.849530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.850188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.850464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.850640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79147f5e-21e2-4bf5-b24a-69fe21aec305 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.850730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.861319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:20.866713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:20.867802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:20.868803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 226/443] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:20.873392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.886604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:20.887204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:20.887478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:20.887747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:20.888401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:20.888697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:20.890086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:20.898088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 218/444] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:20.898888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:20.938111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:20.971961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db1ea9-2912-4156-814f-08f5daea7c7d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:20.997697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd080d7-b92c-426d-9fc2-6ed98ac06dec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.005063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.005687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.005976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.006609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.008030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.009494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.011081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 227/445] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:21.011833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.031902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.032499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.032776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.033048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.033707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:21.034035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.035377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.043511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 219/446] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:21.044122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.057197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.110488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf3b5-e39c-406e-81c7-d504a5a19c48 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.142954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.143539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.143816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.144086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.144316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea3d7b-998e-43fe-8891-55187c424284 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.147381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.177585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.178203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.178486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.178753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.179461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=9e04db42a455473b8b84df28c1a357fc, scope.project.id=1a078b8d31a94f60b425293e30917521) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:21.179764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.181180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.186964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 220/447] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=9e04db42a455473b8b84df28c1a357fc => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:21.187602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.231578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.233106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.274335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.303028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ff8cb-9f6d-4d1c-b40e-64f0810cd622 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.343412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.344535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.344805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.345072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.346029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 228/448] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:21.351775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.392390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.432259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.432259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.466777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf3a11-b9e1-49a2-9f37-2a9c32385986 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.508471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.509229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.509350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.509540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] PATH_INFO: `/v3/projects/1a078b8d31a94f60b425293e30917521` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.510748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=1a078b8d31a94f60b425293e30917521)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.512189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.518007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 229/449] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/projects/1a078b8d31a94f60b425293e30917521 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:21.519033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.520062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.550693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 221/450] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:21.556343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.617923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1b21-7d6a-4317-8a1a-2faf80ebe1e7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.620145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.650964 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.651582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.651858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.652127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] PATH_INFO: `/v3/groups/56c98634dbe04864b28b255e9ffc9770` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.652789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9effc6-9b7e-46e7-86d0-ea7228c9aaab None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.653227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] RBAC: Authorizing `identity:get_group(group_id=56c98634dbe04864b28b255e9ffc9770)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.654692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.656774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 230/451] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/groups/56c98634dbe04864b28b255e9ffc9770 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:21.662612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.687050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.687699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.687971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.688235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] PATH_INFO: `/v3/projects/93dca03ccb1d4c01b8cd3b051645d149` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.689314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] RBAC: Authorizing `identity:get_project(project_id=93dca03ccb1d4c01b8cd3b051645d149)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.690884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.697074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 222/452] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/projects/93dca03ccb1d4c01b8cd3b051645d149 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:21.697949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.741297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.760001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5db6b-4277-49f0-8615-fc0ba60a36fe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.793693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.794316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.794594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.794863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.795584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] RBAC: Adding query filter params (group.id=56c98634dbe04864b28b255e9ffc9770, role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=1a078b8d31a94f60b425293e30917521) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:21.795886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.796883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef2b8-d56e-4b84-9d68-f713a8646717 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.797482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.803144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 231/453] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/role_assignments?group.id=56c98634dbe04864b28b255e9ffc9770&scope.project.id=1a078b8d31a94f60b425293e30917521&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:21.831899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.832542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.832816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.833082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] PATH_INFO: `/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.834274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] RBAC: Authorizing `identity:get_group(group_id=a0cfcdf1f76d4f1991e2e8eb625bd16f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.835731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbc3c4-b39c-4f32-afef-4b576280a22e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.837366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 223/454] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/groups/a0cfcdf1f76d4f1991e2e8eb625bd16f => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:21.843387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:21.882625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:21.951662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaafd1-7a2d-4a32-9a3d-81c33c6ed4f2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:21.986017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:21.986618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:21.986896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:21.987428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:21.988155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] RBAC: Adding query filter params (group.id=a0cfcdf1f76d4f1991e2e8eb625bd16f, role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=93dca03ccb1d4c01b8cd3b051645d149) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:21.988454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:21.989899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6de8f7-6346-46f6-a80f-d4630fb44399 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:21.995546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 232/455] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Aug 17 07:14:21 2022] GET /identity/v3/role_assignments?group.id=a0cfcdf1f76d4f1991e2e8eb625bd16f&scope.project.id=93dca03ccb1d4c01b8cd3b051645d149&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:24.295745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475382-12e3-47cd-9785-b0ff2cde62f1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:24.296255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475382-12e3-47cd-9785-b0ff2cde62f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:24.296255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475382-12e3-47cd-9785-b0ff2cde62f1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:24.298461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 224/456] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:24.304634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:24.305379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:24.305789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:24.334472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:24.335878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:24.423652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09960da-ce46-404a-8987-e9fe192fedf5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:24.424001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09960da-ce46-404a-8987-e9fe192fedf5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:24.424195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09960da-ce46-404a-8987-e9fe192fedf5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:24.425528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 225/457] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:24.432016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:24.432016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:24.432016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:24.441443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 233/458] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:24.456538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:24.458070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:24.560642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 226/459] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:24.767581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:24.811853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:24.910893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f370c9-39d1-4040-bdf0-5b0857ba0498 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:24.924241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:24.967473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:24.969026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:24.969507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:24.970029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:24.980732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:24.982508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:24.994491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a224e54d-b08e-4732-bb64-cabfacfa8f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:25.000919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:25.001869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:25.003130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:25.003130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.003130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:25.003130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 234/460] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:25.003508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d700-490f-48cd-9b05-3873d916941c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.004659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d700-490f-48cd-9b05-3873d916941c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.004659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7d700-490f-48cd-9b05-3873d916941c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.006359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 235/461] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:25.008616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa767-f409-40a5-8a11-b6b1c60d8ddb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.008616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa767-f409-40a5-8a11-b6b1c60d8ddb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.008616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa767-f409-40a5-8a11-b6b1c60d8ddb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.008616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 236/462] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:25.010916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.011200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.011461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.029794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:25.031803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:25.050803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43f25-2595-46f9-b18c-1a21e926ac9c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.086628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.087435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.087862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.088271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.099088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.100685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.109985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 237/463] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:25.109985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.118260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9274152c-5c80-43f8-a5da-3a2b3c08dd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:25.129352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:25.130330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:25.131215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:25.131215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.131215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:25.131215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 227/464] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:25.132711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.133127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.133525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.156338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:25.157933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:25.213149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44fbf-498c-4643-8fc8-bbd918d8a654 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.230424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 228/465] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:25.235015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.254198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.254807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.255084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.255354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.255999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:25.256297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.257672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.270852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 238/466] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:25.276464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.283638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.358364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.396730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471a231-b432-437c-9e3d-34426c18b3e0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.435121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8611c-7db6-4347-9879-93f193e49b03 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.435635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.435944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.436449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.436967 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.438114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.439709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.464579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 239/467] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:25.474620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.477577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.482638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.483128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.483629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.484849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:25.485351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.487385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.502010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 229/468] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:25.508153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.603982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201769-c81b-4c87-9ec7-5f50b7611fc6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.623081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.644435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4519382-ae81-41cb-aedb-d6af43eab019 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.644980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.654998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.656825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.657108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.657384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.672135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.673834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:25.690535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:25.691501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:25.699340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:25.699340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.699340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:25.699340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 240/469] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:25.699570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.699670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.699739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.699739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.699739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.699739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.699739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.731001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 230/470] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:25.732159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.848698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac1385-33cb-4b88-9fe0-2247ef79571b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.864756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac530-ed5d-4d98-8bc4-b8a5d0bd5741 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:25.899661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.900592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.900871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.901142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.907760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:25.908444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.908728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.909000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.909657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:25.909983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.911529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08628f12-a998-4676-a526-9ab923f2f592 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.915345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:25.916813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:25.921375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:25.930889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 231/471] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:25.932345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37640-dc33-482f-8ee1-34d1c0692a75 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.932636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37640-dc33-482f-8ee1-34d1c0692a75 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.932910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37640-dc33-482f-8ee1-34d1c0692a75 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8dde68c0-3cb5-49fa-b8ab-44ee307502b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:25.933239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:25.934126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:25.935361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:25.935361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:25.935361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:25.935526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 232/473] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:25.935593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 241/473] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:25.935658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37640-dc33-482f-8ee1-34d1c0692a75 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:25.942372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:25.942661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:25.942932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:25.964216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:25.965414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:25.996113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:26.045197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 242/474] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:26.046297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:26.076381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37640-dc33-482f-8ee1-34d1c0692a75 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.114013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.114924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.115140 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.115410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.116035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:26.117464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:26.143927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 233/475] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:25 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:26.245709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1706a-4d39-41dd-8df6-40f1e831b36d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.294484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.295449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.295932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.296402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.297862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:26.298386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:26.299982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:26.317578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 243/476] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:26.321746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:26.323351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:26.357950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:26.391291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:26.449658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b999a9-3359-43bc-b42c-50f3c90b4004 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.461490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425afd4-7c1f-464a-b010-dc3f3d6e5909 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.496360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.497338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.497766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.498209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.499059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:26.501149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:26.501553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.502302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.502675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.503044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.503815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:26.505330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:26.512783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.sql.core [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 07:14:26.512783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 07:14:26.512783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [parameters: {'id': 'ef7fc0724cfd481dbc45ae028dcc14af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 07:14:26.512783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 07:14:26.532690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 244/477] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:26 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:14:26.533227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:14:26.534210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application yield resource Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise self.value Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application session.commit() Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 07:14:26.535209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.flush() Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application compat.raise_( Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 07:14:26.536101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:14:26.537001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:14:26.537858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [parameters: {'id': 'ef7fc0724cfd481dbc45ae028dcc14af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:26.540225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 07:14:26.541819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:26.542912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 234/478] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 17 07:14:26 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:26.544241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:26.633720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:26.657580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f2e3-5225-4c9a-973b-82944b5d663c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.694291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.694935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.695210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.695480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.706755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-1fd04fc3-56af-4716-884e-945ff86f10cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:26.712018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:26.712915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:26.713726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 245/479] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:14:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:26.719388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:26.823474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f77d2f-00b3-4aaf-aeae-37cd2c70b65c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:26.840993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:26.858623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:26.859985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:26.860651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:26.860990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:26.861736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:26.862612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:26.864048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5451-c4ab-4dfe-9233-7b376c330313 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:26.873117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 235/480] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:27.923714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5074-cb01-4e7f-8de6-424597f4387d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:27.924265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5074-cb01-4e7f-8de6-424597f4387d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:27.924535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5074-cb01-4e7f-8de6-424597f4387d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:27.926245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 246/481] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:27.931537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d43f-a253-4851-9f03-c98a7c0a8e7e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:27.931965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d43f-a253-4851-9f03-c98a7c0a8e7e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:27.932146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d43f-a253-4851-9f03-c98a7c0a8e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:27.954947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a9c3d43f-a253-4851-9f03-c98a7c0a8e7e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:27.956144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a9c3d43f-a253-4851-9f03-c98a7c0a8e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:28.040562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 236/482] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:28.185223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c695a8-f32a-4df0-914f-8ed81293bc0c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.185403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c695a8-f32a-4df0-914f-8ed81293bc0c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.185685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c695a8-f32a-4df0-914f-8ed81293bc0c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.187339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 247/483] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:28.192895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.193210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.193438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.219577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:28.220847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:28.305097 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 237/484] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:28.327824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c695a8-f32a-4df0-914f-8ed81293bc0c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:28.458433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c695a8-f32a-4df0-914f-8ed81293bc0c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:28.501446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:28.502104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.502382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.502650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.519691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:28.526753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:28.527672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:28.528530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 248/485] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:28.536593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:28.588990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:28.624037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:28.682187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead388-2635-4572-89dc-977c478d8b5d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:28.753126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:28.753793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.754100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.754374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.755216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:28.755516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:28.757560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8e662-2869-4691-8daa-a7f2908d360f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:28.775737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 238/486] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:28.777460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345855-3dc8-4985-9e50-6008e163f23b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.777939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345855-3dc8-4985-9e50-6008e163f23b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.778455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345855-3dc8-4985-9e50-6008e163f23b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.784225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 239/487] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:28.784225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345855-3dc8-4985-9e50-6008e163f23b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:28.791582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9762aca-c94d-440f-8b8f-ea542d9380e8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:28.836865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:28.838194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.838623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.839446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.853053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-174a021d-b0ce-4e88-a978-cdc6a3493c03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:28.861183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:28.862665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:28.863825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:28.866506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 249/488] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:28.867831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.868244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.868647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.891996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:28.894239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:28.914960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345855-3dc8-4985-9e50-6008e163f23b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:28.917196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:28.964667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:28.965464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:28.965830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:28.966213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:28.969530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:28.980642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:28.982740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:28.988558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 250/489] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:28.989639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:29.012944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.014108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:29.014990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:29.014990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:29.014990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:29.018110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 240/490] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.029101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.137141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eed44-c9f7-46c7-8593-bceb0409df2a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.162197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe2e21-ecad-4d08-8603-165fc98635e4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.174068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.174684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.174962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.175231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.175900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:29.176197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.177572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daed8e-80b4-48bb-b198-79a72f0caae1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.187597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 251/491] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:29.189058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93583-d865-4c0e-bbc0-c46a34c15366 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.189336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93583-d865-4c0e-bbc0-c46a34c15366 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.189611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a93583-d865-4c0e-bbc0-c46a34c15366 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.195164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 252/492] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:29.196653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.196938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.197212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.204765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.205763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.206284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.206757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.207652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:29.208341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.209942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.216971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:29.218627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:29.224265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 241/493] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:29.230119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.247862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.269761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.298252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 253/494] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:29.299249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.355203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b68ce-81b9-4a2c-9a25-567051aa056a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.394126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.394760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.395040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.395313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.407672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.409142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:29.425583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.426568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:29.428125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:29.428125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:29.428125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:29.428125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 242/495] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.428125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.436079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc14ad5-3776-4736-8096-f83dd42df72a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.472246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.473234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.473704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.474209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.481891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.483625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:29.500732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.501684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:29.502673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:29.503239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.505679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 254/496] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.506805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.549537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6780c-4c0e-4e92-860a-2a9bc39cfab0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.559196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.587079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.587707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.587984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.588640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.599125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:29.604417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.605330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 243/497] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.606566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.628988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168f61d-28de-442d-9888-7f8bfa371427 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.664000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.664602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.664878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.665149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.665787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:29.666117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.667517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584bdee-be21-4f67-a9f8-6d99d4fe4ca2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.679219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 255/498] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:29.680372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c007b-bdfc-4dce-b938-20f5b7b6b450 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.680655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c007b-bdfc-4dce-b938-20f5b7b6b450 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.680923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c007b-bdfc-4dce-b938-20f5b7b6b450 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.682318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 256/499] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:29.682831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c007b-bdfc-4dce-b938-20f5b7b6b450 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.712708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaea95-ecea-4700-bd28-e8490d9911ec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.737340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.746305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.746900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.747171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.747436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.748145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:29.748441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.750400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.782023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:29.786460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c007b-bdfc-4dce-b938-20f5b7b6b450 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.786863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 244/500] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:29.787685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.820417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.820936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.821206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.821468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.822171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:29.822470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.823821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.832204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 257/501] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:29.832963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:29.885659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224ee7-704b-41e4-8c52-6ba141c2476b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.918355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.919085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.919362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.919625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.929380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f9757a2f-58d8-417a-ae94-79264c31ccdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:29.934046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.935074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:29.935899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 245/502] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.936567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f202f5-e6ff-41ec-93c9-12ed953c53de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:29.936639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.936895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.937676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.954973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:29.956149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:29.970082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:29.970698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:29.970970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:29.971238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:29.978423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:29.979844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:29.991526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:29.992625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 258/503] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:29.993695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.000941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.018726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.027241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 246/504] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:30.028053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.093011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453064f-e473-401f-b0ca-652bbc19af28 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.126016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.126592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.126867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.127136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.142865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868bf6-534c-4498-9f97-6fbf33ad17a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.178982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.179841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.180254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.180658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.192395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.194261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.200231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.201663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:30.209149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:30.210230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:30.211297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:30.211297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.211297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:30.215184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 247/505] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:30.216056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.226359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.244979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.308197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 259/506] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:30.309086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.322691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb5844-798c-4c3c-b77d-4f120ce9875b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.358354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.359594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.359874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.360144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.360808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:30.361143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.362893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.371582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 248/507] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:30.372675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.407257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849610e-24d3-418e-963a-9e077b0384d4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.429647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.441278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.441872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.442174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.442447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.443152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:30.443452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.444862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.464308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.477800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601229c7-b80e-4f66-9e55-8d5037431a0a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.480636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 260/508] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:30.481449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.511839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.512444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.512724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.512997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.513632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:30.513931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.515393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.526774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 249/509] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:30.527554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.581663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb982-9f93-4ee1-8cef-fea3bbbebf4d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.615447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.615993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.616268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.616532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.625095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e06e0-9491-4d98-b111-07bbce6644fa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.626169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.627605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:30.641709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:30.642633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:30.643511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:30.643511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.643511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:30.643511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 261/510] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:30.643724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.660087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.660701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.660973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.661237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.670871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.672907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.675905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.680951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:30.687401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:30.688492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:30.689577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:30.689577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.689577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:30.693989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 250/511] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:30.693989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.750577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92d5e-58f8-4782-95b6-2cf0ef06589c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.785229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.785857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.786159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.786429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.790300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc96f0-419d-4c84-b3df-8592ea90d315 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.796264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.797779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:30.811837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:30.812838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:30.813737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:30.813737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:30.813737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:30.813737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 262/512] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:30.813737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.828199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.828833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.829111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.829381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.893448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.893625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:30.896262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.898169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.910182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df6783-026a-427d-9560-4cf3363991b7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:30.943060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:30.943673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:30.943949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:30.944224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:30.951061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:30.952485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:30.964221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:30.965280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 263/513] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:30.966572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:30.999515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 251/514] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:30.999515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.068669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03b76c-b1ec-4b55-a30c-a83ec6e6737a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.089231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.092323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff4d7-95b1-4ecc-a0f5-003517d3a36c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.101374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.101980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.102271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.102541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.103174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.103467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.104844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.116661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 264/515] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:31.117586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.120784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.131240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.131834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.132109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.132376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.133004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.133295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.134701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.146520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 252/516] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:31.147313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.216889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc541a-579f-4f0c-8b1d-491d4ecd1702 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.243746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abd63-405a-40c8-88e9-9ebe0e5881ff None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.253019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.253609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.253889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.254186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.254811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.255107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.256459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.267970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 265/517] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:31.268800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.276880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.277473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.277748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.278046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.278763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.279062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.280463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.297205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 253/518] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:31.297983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.316343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.330750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.367901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff340c-690b-46fa-8fd1-0085b2a00510 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.398049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7a5d-04d9-49f8-8c1a-6ef83660f54e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.401181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.401795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.402101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.402370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.412610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.414084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:31.427732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:31.428794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:31.429676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:31.429676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:31.429676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:31.429676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 266/519] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:31.429676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.431576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.432278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.432544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.432923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.433690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.435137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.456906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 254/520] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:31 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:31.459350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.540425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628bbc-d7ed-414d-9426-64b284c2013a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.553397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.559501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.580772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.581670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.581942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.582240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.586613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed61d3-89b9-4d69-a596-d60d14e23588 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.589358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.590871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:31.604665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:31.605736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 267/521] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:31.606648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.631989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.632631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.632915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.633189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.644465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.645911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:31.661181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:31.662334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:31.663456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:31.664262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 255/522] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:31.665456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.722321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f34e0-5817-441b-8d20-f30675c9564f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.756838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.757440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.757709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.758000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.777813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5484b0-4ddc-418d-938b-7e0641140bdb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.805779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.818218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.818821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.819098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.819365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.819976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.820299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.821851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.823560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:31.831429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.833418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:31.836116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 256/523] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:31.837015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.939237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 268/524] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:31.940194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:31.950142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8aacf1-a9db-4627-9422-ea7f43898a08 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:31.985450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:31.986246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:31.986593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:31.986931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:31.987949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:31.988315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:31.989756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.012112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 257/525] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.012112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.026472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.052517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776439b0-8ccb-4702-b682-ce9bd1867adc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.067003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.087814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.088434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.088689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.088955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.089668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:32.090050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.091542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.114101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 269/526] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 17 07:14:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.114101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.118701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f2a1-1fa5-48dd-a8eb-24020eb3e191 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.156447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.157078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.157351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.157768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.164352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.165789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:32.179230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:32.180203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:32.181059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 258/527] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:32.182150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.219760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f824312-1621-4163-b9fd-3da7c490ea0a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.253305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.254304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.254643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.254918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.256890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.266688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.268084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:32.284670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:32.285767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:32.287806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:32.287806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:32.287806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:32.288844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2748bb-1c19-42d9-bcba-00c922d31887 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.290735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 270/528] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:32.292301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.305141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.330049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.330643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.330969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.331233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.331943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:32.332281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.333836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.346347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 259/529] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.349719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.417835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38478f-b3af-48fd-9ed1-5a62d6071a16 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.461490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.462774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.463051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.463316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.479242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0121-a85c-4054-9d95-4f7bca822b62 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.523050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.523779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.524123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.524461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.525324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:32.525692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.527353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.536591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.542871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 260/530] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.543998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.552956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.554978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.590668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.655699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813ae5c-f4f9-4027-918b-843b5d09491f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.692987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 271/531] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:32.693400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.694123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.694484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.694957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.695467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.696321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:32.696826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.698442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.711849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 261/532] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.712999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.792971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.810329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5a277-c827-44cd-9484-0303ca77d64c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.847879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:32.849561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.850379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.850787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.851165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.851992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=1660172c4c324dfab2365443884f6784) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:32.852257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e71603-8442-4eb6-89c4-bc447443a00c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:32.852485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.854048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.860350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 272/533] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/role_assignments?user.id=1660172c4c324dfab2365443884f6784&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:32.861314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:32.902169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:32.902968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:32.903250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:32.903525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:32.917602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:32.919405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:32.936823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:32.938417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:32.939276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:32.939276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:32.939276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:32.939276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 262/534] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:32.946113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.083717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863d78-72c4-479e-9272-889949bf04f6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.095746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce900a0-9574-44b3-af5c-cb196799c8d4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.122219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.122859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.123089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.123363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.124008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:33.124309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.126276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.140805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 263/535] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:33.146343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.160810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:33.168392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.169120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.169398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.169665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.191093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.192658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:33.214547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:33.215457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:33.216302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:33.220580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 273/536] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:33.221774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.254331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:33.260264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae151-82ba-4af6-8947-219f56eb0b93 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.301363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.302132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.302412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.302685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.310292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.312900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:33.325889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:33.326800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:33.327743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 264/537] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:33.334471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.426313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:33.436081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd098f8-a336-4987-b382-fae08d067965 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.470325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1411cd-a1b9-4f3b-8933-4661f81b0e41 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.508623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.509244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.509511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.509781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.510498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:33.510965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.512241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.524296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 265/538] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:33.524670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.525280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.525555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.525821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.533984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:33.533984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.533984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.538571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.557984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 274/539] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:33.558883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:33.654299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:33.679476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df38d5-e2a1-4aa0-8f27-2e48ba6a7414 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.685692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5bb84-3286-4fe4-80b2-6ff3f49b5599 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:33.710528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:33.717352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.717972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.718874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.719161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.719914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=fd324314c13743779330b7eb52a1a834) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:33.720233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.721459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:33.721703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79704982-793a-45f6-a0ba-cb290b1240c4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.722205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.722545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.722884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.723668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=0db8a7774fb34badb9da9e2385ef89f0) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:33.724033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:33.725521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad7df8-1714-4ff0-a599-d7bb56a98c9b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:33.727793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 266/540] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:33 2022] GET /identity/v3/role_assignments?user.id=fd324314c13743779330b7eb52a1a834&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:33.729118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9536-c38b-4c01-adf8-f42dac4966dd None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.729396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9536-c38b-4c01-adf8-f42dac4966dd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.729680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e9536-c38b-4c01-adf8-f42dac4966dd None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.735460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 275/542] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:33 2022] GET /identity/v3/role_assignments?user.id=0db8a7774fb34badb9da9e2385ef89f0&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:33.735650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 267/542] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:33.737355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:33.737646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:33.741989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:33.767097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:33.768325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:33.863963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 276/543] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:34.192264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9536-c38b-4c01-adf8-f42dac4966dd None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:34.304780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e9536-c38b-4c01-adf8-f42dac4966dd None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:34.339883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:34.340505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.340779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.341048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.352399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-bad7a82b-28bd-4088-aa42-af6eb0a1bf67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:34.357633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:34.358566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:34.359953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 268/544] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:34.365812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:34.437362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:34.460483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c9ac-826d-4b9c-8897-46ece6d9a7d0 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.461060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c9ac-826d-4b9c-8897-46ece6d9a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.461532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c9ac-826d-4b9c-8897-46ece6d9a7d0 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.463361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 269/545] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:34.468863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.469380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.469847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.488216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:34.488378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c24a1-ba4a-4f86-8c53-63e74d8def26 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:34.489833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:34.528319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:34.529290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.529399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.529608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.530280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:34.530601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:34.533992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:34.541946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 277/546] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:34.547920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:34.595976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:34.618902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 270/547] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:34.718057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ebf7e-e92f-4bed-86dd-48cbe29f1f19 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:34.758308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:34.766729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:34.767363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.767644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.767954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.780371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:34.782447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:34.803859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:34.804767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:34.805644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:34.805644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:34.805644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:34.805644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 278/548] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:34.811064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:34.900737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:34.914701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadccd-85c5-405f-ba85-ac4828dff965 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:34.950577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:34.951179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:34.951456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:34.951728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:34.952365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:34.953231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:34.954618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:34.966524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 271/549] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:34.972122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.030337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.084820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73b5c-3ef8-4ec0-8cb3-119b586e194f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.119022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.119648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.119923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.120249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.127004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5a986-2e16-43b6-bc16-95ae8068f747 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.128743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.130238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:35.143419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:35.146125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:35.148594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 272/550] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:35.157990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.198792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.199449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.199729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.200002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.227211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:35.232389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:35.235051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:35.237041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:35.242383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 279/551] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:35.250918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.257693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a394b-4347-479e-9fac-8d01e0604681 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.274335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.292997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.293656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.293997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.294390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.295147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:35.295504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.297636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13319f0-31bf-4cee-8af9-54f051153e11 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.311158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.318935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 273/552] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:35.324759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36799-a614-498e-9ec1-89edff8fc706 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.325053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36799-a614-498e-9ec1-89edff8fc706 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.325329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c36799-a614-498e-9ec1-89edff8fc706 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.326923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 274/553] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:35.327661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c36799-a614-498e-9ec1-89edff8fc706 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.391952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e22e-1597-4787-8db1-b79df255109e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.427510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.428308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.428948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.429357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.430236 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:35.430715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.432316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c94b5-1bbd-4ac2-95b7-4b7d7923898f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.441569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 280/554] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:35.443142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.443625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.444113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.462685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:35.464189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:35.467317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c36799-a614-498e-9ec1-89edff8fc706 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.514113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.514644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.514918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.515217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.542462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 281/555] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:35.543798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.551627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.599047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.600992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.606166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.726427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 275/556] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:35.728102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.788927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e4d9-55b7-4abd-8577-6843e3ceefac None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.822529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:35.856821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.857454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.857726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.858006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.878806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.880268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.898184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f77c7-d63e-47ce-a937-cb57bb5265af None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:35.907485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:35.908452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:35.909351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:35.909351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:35.909351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:35.909351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 282/557] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:35.916103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:35.955335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:35.955968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:35.956298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:35.956569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:35.970335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:35.972187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:35.992410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:35.993852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:35.994813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:35.994813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:35.994813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:35.994813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 276/558] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:35.994813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.022638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.047654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c046b-bf09-4036-b7ba-f9b7771f823b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.086005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.086611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.086887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.087151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.087779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:36.088074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.089425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.101503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 283/559] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:36.102371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.108781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47740c07-021b-4557-8281-e7a4d77f4083 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.122496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.144471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.145192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.145522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.145813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.158639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-aca2106a-41f7-4ea3-b8d3-263c82adbfc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:36.163873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:36.164934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:36.165853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 277/560] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:36.166626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be24f-336c-4b60-926e-30c4c86942a2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.166626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be24f-336c-4b60-926e-30c4c86942a2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.166626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be24f-336c-4b60-926e-30c4c86942a2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.167842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 278/561] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:36.168837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb737-f75e-4601-83a9-283cd284ecff None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.169111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb737-f75e-4601-83a9-283cd284ecff None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.169376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb737-f75e-4601-83a9-283cd284ecff None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.170812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 279/562] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:36.171603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eb737-f75e-4601-83a9-283cd284ecff None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.211063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5145a5-71d1-4591-9a86-e6d9f5334681 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.244227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.244822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.245096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.245363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.246021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:36.246318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.247703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.259360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 284/563] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:36.260150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.266133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.272347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eb737-f75e-4601-83a9-283cd284ecff None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.304985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.305536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.305813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.306112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.313903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.315388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f702546f-bb72-4cdc-b0f4-2d1314f83f6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:36.326513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:36.328242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:36.329464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 280/564] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:36.330128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.330128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.330128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.346883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:36.348071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:36.366701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07149729-1ea4-434f-8c25-bc2234b0be66 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.375451 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.402470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.403063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.403335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.403598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.404244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:36.404567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.405978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ab9ee-c13c-4c16-83d3-4b3c6ba836bf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.413560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 285/565] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:36.414707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.414984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.422126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.422281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 281/566] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:36.422281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.441824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:36.443070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:36.505088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.514814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 286/567] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:36.516220 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.526477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd9c01-dd01-458b-81c6-c5c8bbdcd702 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.569333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.570442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.571225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.571669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.580346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.581865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:36.593184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:36.594307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:36.595408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:36.600708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 282/568] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:36.600708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.624836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.648237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c88d-45c2-4aef-9cf8-baa8757a3ad8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.699015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.699624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.699896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.700163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.700883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:36.701283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.703282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.710124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87473f-72ac-4fe0-8b23-7a45dc2ae410 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.721182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 287/569] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:36.721990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.753836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.754808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.755135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.755407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.769522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.770987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.775802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:36.787486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:36.788497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:36.790525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:36.790525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:36.790525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:36.790525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 283/570] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:36.790525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.824214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137b3ad-6cde-49c4-a6f6-0e707ede6c35 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.856509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.857108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.857385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.857656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.858365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:36.859200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:36.860625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:36.867638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:36.872574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 288/571] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:36.873360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.890902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c953ad-5ada-4e04-b2d8-f4354ee75866 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.924192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:36.924809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:36.925080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:36.925350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:36.935080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:36.940696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:36.941796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 284/572] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:36.942692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:36.975653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514225f0-bfef-4d23-8204-2c230f412c0e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:36.988708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.009647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.010297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.010569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.010834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.021395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.022858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:37.036688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.037798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:37.038866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:37.038866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.038866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:37.040596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebafbdf-e6ab-44f6-829c-9ce1c10f8ac3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.043536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 289/573] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.043706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.073642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.074355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.074664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.074827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.077325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.085461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:37.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.091605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 285/574] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.092719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.145839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83ff1e-ba8e-4cca-b0ff-49c98a58a190 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.178764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.179360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.179637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.179924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.180536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.180830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.182214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.188542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bc851-cd3f-445d-a053-37bbcaf8aa72 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.193701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 290/575] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.194605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.219040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.222504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.223096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.223372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.223771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.224481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=89eb038259df4fbab0b03d2157e3d55c) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.224896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.226222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.231549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 286/576] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/role_assignments?user.id=89eb038259df4fbab0b03d2157e3d55c&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.232391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.305864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a828-ffec-4269-9d1c-a356e2012991 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.307780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.348551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.349251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.349532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.349802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.350520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.350823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.352873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.362002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6bdb-3282-4f44-8fb9-34853b63bc74 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.367466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 291/577] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.367466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.401830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.402468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.402746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.403016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.403650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.403946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.405298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.417882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 287/578] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.418722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.471025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.488147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9e1a-f24c-4e46-9389-3e7189f07afa None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.524689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.525376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.525631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02689cd-7cb1-41fc-94f4-7f93f4782d39 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.525785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.526132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.526851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.527214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.528674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.537222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 292/579] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.537923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.551324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.566817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.567534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.567881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.568214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.575310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.576826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:37.588391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.589562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:37.590581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 288/580] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.591182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.650793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5627c-f60f-4d46-acf5-5037d4e4c051 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.694652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.695694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.696372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.697210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.699607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fddc6-f34a-477e-ac76-04103a04570b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.710718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.712241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.721047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:37.727792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.728918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:37.730098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:37.730098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.730098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:37.732386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 293/581] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.733224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.741520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.742199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.742454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.742725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.750026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.751448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:37.762532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.763610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 289/582] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.769476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.810568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:37.852865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4160-9334-42c1-a171-266394c46072 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.874639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fdb37-7377-4478-b086-861105845b01 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:37.888538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.889158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.889439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.889709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.900519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.902176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.909695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:37.910350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:37.910627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:37.910897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:37.911612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:37.911912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:37.913333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:37.917343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:37.918316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:37.924692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:37.924692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:37.924692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:37.924692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 294/583] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:37.924692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.931222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 290/584] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:37.936004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:37.981484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.032604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97335-a02f-48bc-a702-26c3412b1f96 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.040723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.044833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45232488-7e6a-4fbe-9fef-30bddaea79a2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.068565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.069444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.069790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.070151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.070851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.071214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.072686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.081360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.082060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.082401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.082747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.083496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.083801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.085216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.090089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 295/585] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.090089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.106103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 291/586] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.106103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.201408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2192f45-c4de-4d59-8ddf-35437532c3c6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.217584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.217775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683d97-d0c4-4fe7-abca-061b68945d52 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.242922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.243524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.243798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.244064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.244705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.245003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.246403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.254223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.254840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.255107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.255372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.259063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 296/587] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.259765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.272522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.274289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:38.289044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:38.290347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:38.291471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:38.291471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:38.291471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:38.292179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 292/588] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:38.293042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.308119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.371036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb227e-cc3f-43c5-b51f-cfc7f9f311f6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.406388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.407110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.407456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.407867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.411566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01234a-bdd3-4cce-895a-d3b02e9a80ed None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.416290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.417721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:38.432292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:38.433429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:38.434430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 297/589] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:38.435037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.455188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.456065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.456517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.457421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.467991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.472693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=36a43ff4bca2482d871b6f8b7dec3a02, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.474157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.488872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 293/590] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:38 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:38.489901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.564219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.573603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959403a-e9ac-4263-b63a-3e449c43fad8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.615595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.616365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.616712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.617045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.621469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a46708-2c9e-46b6-bc6f-c67abb4c911e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.626349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.627919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:38.640753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:38.641791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:38.642999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:38.646535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 298/591] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:38.647527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.670731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.671914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.672214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.672499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.673153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.673454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.675538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.688899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 294/592] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.689562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.759395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.771369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4fa3f-9e31-43a5-860a-34ef9baae337 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.816902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.817867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.818419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.818886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.819477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6659-80b3-4c9f-ab8a-c9044c984e7a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.820030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.820524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.822220 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.841130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 299/593] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.842315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.845149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:38.871002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.871750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.872029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.872301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:38.873038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:38.873576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:38.875827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:38.899514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 295/594] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:38.902773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:38.955907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d8855-4860-476f-8a4e-d84d5c4f644c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:38.992633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:38.993677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:38.994093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:38.994456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.001770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.003371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:39.016633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:39.017713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.018860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:39.025123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 300/595] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:39.025123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.036659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee108777-af13-40ba-bf88-521a907e8275 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.038390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.071129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.071918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.072273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.072637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.083699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.085309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:39.101148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:39.102345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:39.103488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:39.103488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:39.103488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:39.104469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 296/596] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:39.105700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.136637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.139438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf732-3ecf-49c3-ba5a-4e4c3107374c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.174716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.175345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.175620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.175886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.187782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.189228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:39.208810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:39.209948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:39.215832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:39.215832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:39.215832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:39.215832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 301/597] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:39.215832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.216198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ff15-4f72-4274-94c8-506d51348512 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.250474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.251147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.251422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.251688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.252368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:39.252697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.254146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b63ee5-f1dd-4a01-9cd0-c72c42fd9550 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.271861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 297/598] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:39.273259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1a91-0d93-4e43-b8fc-c4c4b3c538b0 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.273538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1a91-0d93-4e43-b8fc-c4c4b3c538b0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.273809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1a91-0d93-4e43-b8fc-c4c4b3c538b0 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.277994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 298/599] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:39.277994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1a91-0d93-4e43-b8fc-c4c4b3c538b0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.286743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.329611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca032dcd-e722-49be-ad29-65faa554ac40 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.367451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.368055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.368332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.368655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.369293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:39.369587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.370981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.378284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.388553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 302/600] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:39.388553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.394813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1a91-0d93-4e43-b8fc-c4c4b3c538b0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.431870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.432701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.433038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.433369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.434104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:39.434463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.435948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba0638-60c6-4c35-bee4-3411fbe19105 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.447812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 299/601] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:39.449049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.449397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.449731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.469599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:39.470900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:39.497509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90bdb7-ca2b-4124-8545-17307dd6752e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.522029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.534127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.534780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.535054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.535351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/1660172c4c324dfab2365443884f6784/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.544476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 300/602] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:39.545811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.553627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=1660172c4c324dfab2365443884f6784, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.555264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.574003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 303/603] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:39 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/1660172c4c324dfab2365443884f6784/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:39.574003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.732336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.758618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07c95-3690-4085-bcaf-474cb4084579 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.761416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23e911-0ee1-4f1b-aee6-1253def566e9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.802303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.802857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.803138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.803406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.805494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:39.806414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:39.806842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:39.807300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:39.810858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.812905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.815366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:39.816993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:39.824802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:39.825888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:39.827013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 304/604] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:39.834875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:39.840394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:39.841453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:39.842591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:39.844413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 301/605] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:39.852222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:39.887083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:39.970652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04487503-6f5d-4a47-970b-f7db44e02b1e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:39.982160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7786d5-df1c-48e8-9a4b-b0a2d05e2780 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.009287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.010084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.010719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.011084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.012284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:40.012949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.014742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.022341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.022941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.023209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.023480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.024162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:40.024459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.025992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.039278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 305/606] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:40.039457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:40.039537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.045030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 302/607] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:40.046356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.164514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:40.165430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062df90-f8fe-4be0-b92f-8b93bed0a8f5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.177894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c137b-f304-4ae9-883b-3ecaa74502e3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.205531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.206226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.206503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.206774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/0db8a7774fb34badb9da9e2385ef89f0/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.222963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=0db8a7774fb34badb9da9e2385ef89f0, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.224545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.224778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.226042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.226537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.227158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.240006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:40.249997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 303/608] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:40 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/0db8a7774fb34badb9da9e2385ef89f0/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:40.249997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:40.254505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:40.255424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:40.256287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:40.258923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 306/609] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:40.266369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.306393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:40.364117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd61ce-4769-4e56-9f7c-f377a688fcc9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.421674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca03a0-7f1b-42c0-adb5-b4413142b9b7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.435852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.436584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.437408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.437678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/fd324314c13743779330b7eb52a1a834/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.463307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.464293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.464768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.465256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.466240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:40.466740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.468516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.469228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=fd324314c13743779330b7eb52a1a834, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.470870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eae5a-7e98-4657-84ae-167ad53773f6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.483015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 307/610] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:40.485397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.502008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 304/611] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:40 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/fd324314c13743779330b7eb52a1a834/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:40.514001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:40.525129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687566b3-bf94-4e43-a2d2-5a5dc653ff38 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.525476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687566b3-bf94-4e43-a2d2-5a5dc653ff38 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.525681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687566b3-bf94-4e43-a2d2-5a5dc653ff38 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.527383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 305/612] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:40.532876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.533161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.533422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.555442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:40.557150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:40.627734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a673-44a2-4f06-b3c8-74e5a7dddf77 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.646305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 306/613] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:40.669574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.670279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.670557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.670875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.683755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.685150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:40.701286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:40.702353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:40.703571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:40.703571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:40.703571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:40.703571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 308/614] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:40.709651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.752445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:40.836192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd2e9-14e4-4221-8bbf-f6bcf5b39a4f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:40.879825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:40.880771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:40.881224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:40.881697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:40.882545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:40.883034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:40.884579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:40.900502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 307/615] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:40.906787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:40.999148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.017873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.051952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e8d95-b40d-4227-a075-0382d216b3da None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.127225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.127875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.128156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.128425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.147081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.148555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.165378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8321be-54bb-4117-acaf-131f660c53e6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.170259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:41.174340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:41.175273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:41.176780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 309/616] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:41.182089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.231160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.231787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.232059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.232323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.255778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:41.262517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:41.263436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:41.264295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:41.272202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 308/617] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:41.273602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.393308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324496e-f623-4e5b-9a92-88ccb39d545b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.451272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.454416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4bfa4-a236-43dc-8971-182b93311b99 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.471782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.472400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.472668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.472938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.473667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:41.473996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.475543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.502708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.503476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.503915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.504304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.505081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:41.505473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.506111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 310/618] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:41.511351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.511479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.526253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 309/619] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:41.531859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.555390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.690582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd663ce-e9b7-431d-92d1-2b31b54b6e43 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.701172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182db60c-f822-4646-8968-88d04bcf0744 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.751586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98663495-74b1-4139-80fb-cc063570520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.752336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663495-74b1-4139-80fb-cc063570520d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.752559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663495-74b1-4139-80fb-cc063570520d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.752883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98663495-74b1-4139-80fb-cc063570520d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.753719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.754472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.754878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.755253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.764443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663495-74b1-4139-80fb-cc063570520d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.766505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98663495-74b1-4139-80fb-cc063570520d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.768001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.770025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-98663495-74b1-4139-80fb-cc063570520d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:41.782268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:41.783468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:41.784386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:41.784386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:41.784386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:41.784386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 311/620] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:41.784861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5923ca-8d74-48ba-9d8b-2b4bec856eea None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.786635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5923ca-8d74-48ba-9d8b-2b4bec856eea None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.786635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5923ca-8d74-48ba-9d8b-2b4bec856eea None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.787006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 312/621] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:41.790039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5923ca-8d74-48ba-9d8b-2b4bec856eea None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-10dbf0fa-b227-46f7-9fe8-aa629c170e09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:41.797079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:41.798115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:41.799033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:41.799033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:41.799033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:41.799033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 310/622] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:41.800628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.801161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.801535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.825185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:41.826607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:41.854421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.905443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:41.907758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5923ca-8d74-48ba-9d8b-2b4bec856eea None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:41.917207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 311/623] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:41.918695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:41.946579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:41.947347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:41.947715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:41.948124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:41.948876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:41.949297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:41.950906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:41.964986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 313/624] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:41.979617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.041798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f19938-7162-4dd3-8df8-4829ea690baa None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.082105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.082940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.083369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.083986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.085147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:42.085633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.087509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.101315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 312/625] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:42.106337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.173503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.176090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.189673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ef4c8-f8c6-4196-a26e-bb848728dece None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.228721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c3461-8798-430e-807f-be2b5ecb4c01 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.260775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.261355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.261629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.261896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.269385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.270294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.270774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.271226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.275578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.277044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.280121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.281865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:42.294559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:42.295535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:42.297070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:42.299296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 313/626] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:42.299735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:42.300612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:42.301607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 314/627] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:42.306414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.306910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.421888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52def2a-3821-4aab-bfcf-d65207058b05 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.440120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ec46f-7cb7-46cd-bcaf-4d6cdc92cf85 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.442789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.458565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.459428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.459824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.460488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.461324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:42.461725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.463928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.484439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.485294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.485733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.486197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.487044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:42.487768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.489428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.491161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 314/628] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:42.492356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.505384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 315/629] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:42.506871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.529893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.612874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3a37-f865-4d47-a125-cd9b0083468d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.648872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82220-bd5c-4f1d-b0d9-ad0544684208 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.650357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.651082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.651353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.651623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.663185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:42.668193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:42.669153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:42.670047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:42.674077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 315/630] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:42.675363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.693632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.694430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.694536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.694805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.709195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.766024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.767485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffdf93-27c9-4ee0-b535-cf6c33603b0c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.779987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a617f1-d045-4801-b3eb-f269a32020e4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.784461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.813307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:42.813954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.814267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.814554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/89eb038259df4fbab0b03d2157e3d55c/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.828735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=89eb038259df4fbab0b03d2157e3d55c, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:42.830195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c4a7a-18ef-4b82-bf67-a8f93a296338 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:42.842114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 316/631] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:42 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/89eb038259df4fbab0b03d2157e3d55c/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:42.843900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512f3-ee9c-4cef-91de-0da04a61e28d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.844176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512f3-ee9c-4cef-91de-0da04a61e28d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.844442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512f3-ee9c-4cef-91de-0da04a61e28d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.845666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 317/632] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:42.846439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce512f3-ee9c-4cef-91de-0da04a61e28d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 316/633] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d6-903c-45d3-a834-f2fde49ffc44 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d6-903c-45d3-a834-f2fde49ffc44 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f3d6-903c-45d3-a834-f2fde49ffc44 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 317/634] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:42.884755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:42.885319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:42.904689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:42.906723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:42.951740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:42.973542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce512f3-ee9c-4cef-91de-0da04a61e28d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:42.993298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 318/635] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:42.994198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.009407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.010066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.010941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.010941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.011235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:43.011482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.012841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebcad-8074-4707-842d-75b4f25d5707 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.026048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 318/636] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:43.027633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.027974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.028251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.047013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:43.048361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:43.054333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.107537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d833c-9efa-42af-b8ce-b5dff876c21a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.137124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 319/637] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:43.138605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.147114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.147884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.148313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.148684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.165581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.167274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:43.183713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.184716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:43.185624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:43.185624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:43.185624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:43.185624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 319/638] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.190853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.235598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.287973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65936de2-83f1-4c7f-96ec-ede0f39eb327 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.328787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.337050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d710-4a30-4652-8733-78a5146ce82b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.344321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.344952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.345226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.345491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.361019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.362761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:43.380639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.381881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:43.383189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:43.383189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:43.383189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:43.383189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 320/639] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.383189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.391997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.392892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.393379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.394014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.394956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:43.395460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.397080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.414885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 320/640] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:43.416098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.492151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00607d-5220-40f9-9d78-ca3d76daaf80 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.518769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.524604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acfafa-4abe-478d-8f51-b06deb8ef72f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.528011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.528665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.528938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.529201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.540328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:43.545389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.546434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:43.547326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 321/641] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.548037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.567581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.568186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.568457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.568723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.569357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:43.569649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.571047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.583294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 321/642] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:43.584065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.603527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.657877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684eb983-fc12-4bbd-af3f-1c26f22b787b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.685122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876ad80-7e50-4d5a-84af-d698f56410f5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.694667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.695279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.695858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.696127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.703717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.705147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:43.717466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.719054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 322/643] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.719983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.725358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.726028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.726311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.726580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.737690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:43.742633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.743572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 322/644] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.745492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.772359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.828019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:43.830875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ea079-974b-4d6f-991b-68108cfe248b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.856070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce82b2b-5030-42da-bb09-617a3b2f88ed None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:43.867404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.868247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.868377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.868539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.869197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:43.869498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.870901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.879569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 323/645] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:43.884519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.893180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:43.893808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:43.894111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:43.894378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:43.902022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:43.903485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:43.915528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:43.916468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 323/646] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:43.917440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:43.993846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad257c6-48af-42c7-8c5d-3334489d170b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.002695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.027715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc01e2-9989-47c7-ae8b-0a9e7aadab13 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.028648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.029248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.029526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.029828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.031034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.031333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.032739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.049805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 324/647] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.049805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.068984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.069584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.069860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.070156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.070805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.071129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.072475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.077732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.082618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 324/648] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.083394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.153544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20451138-07fd-473e-a1a4-30a46fe0836e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.188269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.188890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.189166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.189432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.194326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863f75-99d0-4449-b339-15bed28cd65d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.199790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.201215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:44.215946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:44.216943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:44.217918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:44.217918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:44.217918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:44.217918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 325/649] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:44.217918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.241025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.246034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c16a7-982f-4564-9f23-2389add160de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.246645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c16a7-982f-4564-9f23-2389add160de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.246939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c16a7-982f-4564-9f23-2389add160de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.247193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c16a7-982f-4564-9f23-2389add160de None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.247896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c16a7-982f-4564-9f23-2389add160de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.248196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c16a7-982f-4564-9f23-2389add160de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.249655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c16a7-982f-4564-9f23-2389add160de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.267781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 325/650] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.268496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c16a7-982f-4564-9f23-2389add160de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.326273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.333012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa00f1-7196-4497-a34a-34300bcbcd83 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.367907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.368507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.368781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.369053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.369773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.370120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.371544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.377341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 326/651] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.378169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.378416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c16a7-982f-4564-9f23-2389add160de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.425745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.426782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.427242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.427693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.439581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.441466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:44.463317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:44.464352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:44.465416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:44.465416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:44.465416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:44.469233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 326/652] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:44.470430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.489269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.509844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06841fe-846e-4019-bda9-c7b723dc828f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.547883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.548489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.548761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.549022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.549661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.550067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.551331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.568682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 327/653] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.568682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.598612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4772e-794a-4d56-b63f-c3109f97b9af None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.613888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.643751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.644836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.645127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.645672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.695215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3033170-56be-4248-92ae-b7b8dc6b0312 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.733263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.734305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.734965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.735503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.735771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.736176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.737009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:44.737873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.739582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.753206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 328/654] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:44.758444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.763196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.852682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 327/655] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:44.853529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.865186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:44.871950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8af694-fd3f-47e3-b472-4379c75bb102 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:44.907494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:44.908118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.908391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.908654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.916400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:44.917808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2db17f3e-1e4c-423c-a654-2c5db42fca23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:44.928959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:44.930025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:14:44.931029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:44.934679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 329/656] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:44.935806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d77f-2c62-4fe2-8ff3-32397ca46527 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:44.936089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d77f-2c62-4fe2-8ff3-32397ca46527 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:44.936351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d77f-2c62-4fe2-8ff3-32397ca46527 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:44.938279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 330/657] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:44.942750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998d77f-2c62-4fe2-8ff3-32397ca46527 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:44.960662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3328c-9a76-4821-a8e9-1f76e22656e6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.004838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.005628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.006025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.006367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.009425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.015379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.016828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:45.029277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:45.030317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 328/658] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:45.031306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.055295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998d77f-2c62-4fe2-8ff3-32397ca46527 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.090143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.090764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.091037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.091309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.101911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.103357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.107694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-87b6f5aa-c421-43a1-8cb6-db45be48c25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:45.118567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:45.119573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:45.120537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:45.120537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:45.120537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:45.120537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 331/659] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:45.121174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.121471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.121718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.139829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:45.140994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:45.147346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcc6a9-c780-4edd-b60e-35c999942fcb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.181823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.182462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.182738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.183003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.183724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:45.184020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.185441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.203950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 329/660] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:45.204778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.213188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 332/661] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:45.218898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.269727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.316196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72745bd9-6e95-4c78-956c-3889344f045d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.326665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b14a-105b-4a3c-9af9-9fdf106fbce6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.345038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.354960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.355771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.356141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.356801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.357414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:45.357810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.359923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.378406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.379297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.379743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.380180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.381024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:45.381501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.383065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.383176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 330/662] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:45.384141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.396730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 333/663] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:45.397900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.491291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49bdf6-ce55-468a-aef1-9479f5c02107 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.505877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d8100-1cba-490d-be9a-d6a899d555e8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.513107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.529922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.531338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.531776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.532054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.540744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.541387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.541611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.541873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.586737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.601942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.603435 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.621217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.622542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.707274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 331/664] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:45.708186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.744240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 334/665] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:45.744240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.751193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.809594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.825473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d634b-166e-4abf-9420-2202de0d39f9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.851658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468972c-e0df-4a57-918c-cd0c07908025 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:45.859841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.860476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.860751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.861020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.867910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:45.869336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:45.880168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:45.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 332/666] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:45.882047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.893792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:45.894700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:45.895162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:45.895637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:45.906583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:45.911542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:45.912482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:45.913344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:45.915172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 335/667] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:45.916105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:45.986766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:45.991120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e01f6-2d88-4048-97aa-a7cf0a8ec9b8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.024889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d662230-1eeb-4870-9bf8-9d228a38dc9e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.028439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.029231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.029511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.029774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.041798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.043455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.050549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:46.059006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:46.059978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:46.066122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:46.066122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.066122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:46.066122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 333/668] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:46.066122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.066424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.066687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.066870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.067096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.078165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.079716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:46.096010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:46.097138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:46.098103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:46.098103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.098103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:46.098103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 336/669] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:46.098345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.179273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b1e7-587e-4b70-a0d1-f608c0783cf2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.206067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc432e-f3ab-4c9c-9d66-1ea5dde6642d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.214436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.215040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.215328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.215582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.216261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.216557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.218048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.224252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.231217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 334/670] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.236732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.244713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.245714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.246012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.246281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.246935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.247587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.249892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.258331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 337/671] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.258942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.302632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.353712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d2f3c-dd35-4e3d-a8db-09154477bb62 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.366766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc5da-e363-47c8-a83c-dfce46a044dc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.396261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903483-5aed-4894-950c-d86822871c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.396858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903483-5aed-4894-950c-d86822871c16 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.397375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903483-5aed-4894-950c-d86822871c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.397375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903483-5aed-4894-950c-d86822871c16 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.399530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903483-5aed-4894-950c-d86822871c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.399880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903483-5aed-4894-950c-d86822871c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.401235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903483-5aed-4894-950c-d86822871c16 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.402119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.402716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.402989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.403255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.403884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.404179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.406087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.413696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 335/672] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.414458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903483-5aed-4894-950c-d86822871c16 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.423110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 338/673] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.428181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.470526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.514999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903483-5aed-4894-950c-d86822871c16 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.526964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc30ec1-0b2f-499a-9170-6b5a590ae27b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.531776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.548799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.549395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.549669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.549934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.550675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=1660172c4c324dfab2365443884f6784) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.550977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.552519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.558131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 336/674] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/role_assignments?user.id=1660172c4c324dfab2365443884f6784&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.558829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.560654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.561314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.561667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.561975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.588389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.589990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:46.605991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:46.607072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:46.607991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:46.607991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:46.607991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:46.610210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 339/675] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:46.611430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.681072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9788f28-896c-4223-9f39-401975a91a0e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.714533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.720273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.720909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.721189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.721459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.725899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c222-c3cb-48ab-adef-8ab0cae44cdc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.729657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.731190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fa14f980-c946-41d1-b614-d0a8396af98b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:46.744973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:46.746127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 337/676] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291733-86dd-49dc-8683-31b9a372b90d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.750958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291733-86dd-49dc-8683-31b9a372b90d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.751628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291733-86dd-49dc-8683-31b9a372b90d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.751628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 338/677] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:46.751628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291733-86dd-49dc-8683-31b9a372b90d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.776080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.776771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.777055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.777344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.786127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.787592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:46.799291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:46.800222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:46.801148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:46.802170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:46.802264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 340/678] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:46.802264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.871833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291733-86dd-49dc-8683-31b9a372b90d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.907962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1b28-8485-4582-9a41-7cd19ed17172 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:46.910958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.911452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.911730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.911997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.912635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.912931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.914324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbefd2-5d61-42f0-94d6-fe062a86de32 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.930203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 339/679] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.930203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.930203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.930203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.946352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:46.947640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:46.949821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:46.950992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:46.950992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:46.950992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:46.951660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:46.951960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:46.954141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:46.967056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 341/680] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:46.968038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:46.989940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.028834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 340/681] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:47.029804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.063426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.113474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0932-5e66-4db0-9c37-0a758b1f318f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.141980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29dc70-a13e-4265-ae9a-12fe5d19e2b8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.160708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.161578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.161865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.162200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.163248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:47.163558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.164992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.180912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.181807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 342/682] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:47.182675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.186612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.187009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.187427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.195727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.197414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:47.210293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:47.211497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:47.212730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:47.218369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 341/683] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:47.218369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.274510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.315590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc7a44-308b-4edd-8529-e63642333c33 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.316775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.327245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca227e-ba53-442b-8583-19eae6e09889 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.350659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.351892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.351892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.352100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.352847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=0db8a7774fb34badb9da9e2385ef89f0) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:47.353225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.354766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.361460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 343/684] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/role_assignments?user.id=0db8a7774fb34badb9da9e2385ef89f0&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:47.362806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.379704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.380433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.380817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.381189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.382173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=fd324314c13743779330b7eb52a1a834) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:47.382557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.384122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.398755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 342/685] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/role_assignments?user.id=fd324314c13743779330b7eb52a1a834&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:47.399791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.528885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac521b-3476-4a51-aed9-8acb576adc0e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.595033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473e4b1-2370-4c99-b542-78ea0101f618 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.604620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.604620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.604620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.604620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.605064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:47.605064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.606394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.614419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.632255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 344/686] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:47.637992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.652474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.653343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.653766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.654771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.668664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:47.674017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:47.675193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:47.676170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 343/687] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:47.683434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.712701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:47.782489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ac588-6c8b-4cc0-8cd4-b9897ae8ea39 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.838883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad12bf-866a-459b-b086-5dad18ce99eb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:47.877345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.878018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.878256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.878587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.879454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:47.879864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:47.881567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:47.881857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:47.882668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:47.883105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:47.883526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:47.891725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 344/688] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:47.898131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:47.989058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.008067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.018346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437cf0-cc22-410e-ad31-9afeb5dba653 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.030779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.032270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.089341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.090128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.090405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.090787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.115027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.116731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:48.142678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:48.143710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:48.144625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:48.144625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:48.144625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:48.144625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 345/689] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:48.149518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.177359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 345/690] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:14:48.187462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.274123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a530-27af-4f13-bbe7-89ea81250550 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.298777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.314930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.315885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.316328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.316745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.317543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:48.318007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.319777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.332981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 346/691] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:48.338610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.339263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.364187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bc789-1fac-4b21-9d40-30c4dbf7fee4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.432667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.433281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.433557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.433826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.454938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.456410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.474274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dbb67-c692-4638-a017-5a1399e17155 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:48.480141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:48.481126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:48.482085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:48.482085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:48.482085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:48.482085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 346/692] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:48.490850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.528131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.528684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.528959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.529222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.542661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.544111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:48.568578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:48.569618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:48.570617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 347/693] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:48.575232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.632155 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc0ad-c123-4f08-a6ef-00589388b449 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.664102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.668644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.669256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.669529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.669800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.670467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:48.670782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.672754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.685442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 347/694] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:48.692191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.707655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.758695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99b14c-df1c-4851-bf9c-3b85dbf3e1b5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.815509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.816326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.816622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.816898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.817911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:48.818250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.820552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc4453-7818-46af-a5d1-c8cbfe5ae7a6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.838345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29cd29-3a44-4fa9-9256-a1f976d9f2be None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.845200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 348/695] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:48.846481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd72b-9e57-475a-bfd8-1946cab89493 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.846775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd72b-9e57-475a-bfd8-1946cab89493 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.847121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadd72b-9e57-475a-bfd8-1946cab89493 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.848617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 349/696] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:48.855028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadd72b-9e57-475a-bfd8-1946cab89493 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:48.880589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:48.881217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.881498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.881771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.888527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:48.890580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-16ae03f1-f148-4ca2-9206-86f12146110c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:48.901729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:48.902686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:48.903598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 348/697] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:48.904579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:48.904709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:48.904905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:48.923986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:48.925163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:48.975721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadd72b-9e57-475a-bfd8-1946cab89493 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:48.987909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:48.988337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.006340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 349/698] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:49.007555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.015174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.015917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.016304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.016647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.129669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.131555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.163582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225103-57b0-45f3-bbd5-1b806f8377d9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.219385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.219999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.220280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.220551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.221247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:49.221548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.223023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.250701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 350/699] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:49.262944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.278528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 350/700] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 07:14:49.286962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.299289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.375936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.424917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c74ee2-87de-4c4a-a4b9-6a7b50022086 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.433644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5648-ed0e-4508-a533-cd23d07a2ab6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.460850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.461454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.461731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.462025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.462813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=89eb038259df4fbab0b03d2157e3d55c) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:49.463138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.464562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.471570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 351/701] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/role_assignments?user.id=89eb038259df4fbab0b03d2157e3d55c&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:49.472447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.482517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.483597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.484079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.485014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.498286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.500042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:49.517339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:49.518420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:49.519371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:49.519371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:49.519371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:49.523106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 351/702] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:49.524496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.601856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21063a5-9b57-46e1-be47-82464917def3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.603123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.638194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.656279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.656990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.657268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.657544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.669669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.671228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.675533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366a5ef-985c-4098-815e-7d0fe4da58f3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5e948e58-c69d-43ab-b815-0547e6166e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:49.696604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:49.697685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:49.698703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:49.698703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:49.698703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:49.698703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 352/703] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:49.699388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbfbe8-84db-4c98-8ab1-7c8d71970902 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.699560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbfbe8-84db-4c98-8ab1-7c8d71970902 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.702509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbfbe8-84db-4c98-8ab1-7c8d71970902 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.702509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 353/704] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:49.706604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbfbe8-84db-4c98-8ab1-7c8d71970902 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.721427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.722785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.723551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.724062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.725084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:49.725992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.727857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937eb0a-7c4a-43d8-9ae4-d33457148466 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.744659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 352/705] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:49.746036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.746476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.746821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.768493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:49.769670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:49.831032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbfbe8-84db-4c98-8ab1-7c8d71970902 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:49.847922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 353/706] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:49.848951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.868036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:49.868859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.869166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.869507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.870256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:49.870622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:49.872059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1fef-ae60-4f87-b6fd-2b4d79ac8f08 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:49.885815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 354/707] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:49.890205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3593-9dbf-48f2-856d-a0f78033f503 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:49.890205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3593-9dbf-48f2-856d-a0f78033f503 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:49.890205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf3593-9dbf-48f2-856d-a0f78033f503 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:49.890205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 355/708] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:49.892529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3593-9dbf-48f2-856d-a0f78033f503 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:49.916741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.930903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:49.980210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694409c2-3118-4bfc-b74c-35b978178da8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.015399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf3593-9dbf-48f2-856d-a0f78033f503 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.019228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.020133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.020609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.021073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.032987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.034917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d982a0a7-33b7-44c6-9340-626dd6dc219e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:50.047474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:50.048399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:50.049312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:50.051277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 354/709] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:50.052685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.053170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.053671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.056457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.057084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.057366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.057636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.058534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.060036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.074586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:50.076084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:50.090613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 356/710] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:14:49 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:14:50.090613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.195450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 355/711] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:50.196405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.218028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:50.240100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067347d5-68b9-4a96-b9ab-047bb3662ed8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.256919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:50.284617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.285564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.286164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.286633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.287584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:50.288101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.290470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.304387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 357/712] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:50.309879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.317760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ea760-c85d-48d4-8238-5ee56dc43e53 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.352893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.353525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.353798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.354122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.354706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.356073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:50.368311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:50.369494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:50.370424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 356/713] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:50.376325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.458380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ac2e1-b636-422d-bda3-b18db75e897b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.505789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.506886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.507725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.508414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.509284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:50.509730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.510288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33f5aa-8d09-4a65-9031-dd159d1b61e3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.511473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.514155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:50.520080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 358/714] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:50.533839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.552602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:50.560574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.562193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.562606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.562967 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.563758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:50.564155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.565873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.571363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 357/715] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:50.577326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.649344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f26f20-ff46-4ef0-bdd2-bca0f3e3b644 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.697126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.698052 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.698505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.698943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.699785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.701407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.705992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c81d-069f-42bc-a7e3-7f41df248db8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:50.732079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:50.733309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:50.734649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:50.738736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 359/716] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:50.746083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:50.749988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.749988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.749988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.749988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.750445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:50.750445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.751664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.758417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 358/717] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:50.868567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:50.902502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb269a-1de1-4d94-b8e8-fa5ee5239462 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:50.940580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:50.941193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:50.941465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:50.941731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:50.942404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:50.942699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:50.944123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199a975-fe24-4998-9adf-4dc35996673e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:50.949026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 360/718] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:50.955103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:51.011257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:51.063881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0ba73-ead7-4505-bf6d-a150a61eaf93 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:51.098488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:51.099092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:51.099367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:51.099690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:51.100316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:51.100647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:51.102165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5b0aa-b361-4652-b661-671716b83dfb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:51.107089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 359/719] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:14:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:51.841243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13320d-b463-4ffb-9dc5-620a915bd88f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:51.841787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13320d-b463-4ffb-9dc5-620a915bd88f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:51.841787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13320d-b463-4ffb-9dc5-620a915bd88f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:51.843444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 361/720] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:51.848713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:51.848996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:51.849267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:51.868140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:51.869314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:51.938884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 360/721] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:52.271626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13320d-b463-4ffb-9dc5-620a915bd88f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:52.417081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13320d-b463-4ffb-9dc5-620a915bd88f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:52.469104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:52.469732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:52.470025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:52.470295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:52.483862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:52.494862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:52.499644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:52.500642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:52.501524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 362/722] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:52.506808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:52.534231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:52.625637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba6ded-bf34-49b5-8f16-31295354c33c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:52.659786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:52.660449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:52.660728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:52.660996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:52.661661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:52.661979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:52.663348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc9168-184f-4b82-8174-a0007a3c7bc6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:52.671901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 361/723] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:52.677311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:52.687456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdee5-9626-416c-8f4f-1b912b109faa None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:52.687736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdee5-9626-416c-8f4f-1b912b109faa None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:52.688008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cdee5-9626-416c-8f4f-1b912b109faa None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:52.691691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 362/724] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:52.695035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:52.695311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:52.695578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:52.728320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:52.731712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:52.851310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 363/725] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 07:14:52.857756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558049f-6385-41ba-9148-2227a46dc106 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:52.900693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:52.901317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:52.901594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:52.901864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:52.919950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:52.921517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-97f72d87-769a-487b-ae10-7a20370f8425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:52.940150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:52.941170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:52.942133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:52.942133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:52.942133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:52.942133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 363/726] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:52.947042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:52.972088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.084770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff0509-aea2-44eb-9d8a-31c2d460aec4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.117159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985ea-1425-45bd-9f41-73898846b724 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.117454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985ea-1425-45bd-9f41-73898846b724 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.117692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985ea-1425-45bd-9f41-73898846b724 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.119043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 364/727] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:53.124665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.124947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.125221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.128557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.129617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.130131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.130586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.131688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:53.132196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:53.134047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:53.146844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 364/728] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:53.147746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.156390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:53.157612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:53.206840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.232466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 365/729] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:53.234029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.239136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.267588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef1633-923f-4a20-b566-3c8cb0440941 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.307084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.307947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.308399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.308820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.329108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:53.335129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:53.336275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:53.337344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:53.348953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981764a5-0bf7-4990-a19f-f625b116f882 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.351518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 365/730] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:53.359280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.406579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.407123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.407399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.407662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.416915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:53.419493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f1ff8bde-6806-43c7-9a65-681aa2ce8d4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:53.434714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:53.435734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:53.437305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:53.441158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 366/731] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:53.442886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1cab5-de8c-4cb0-950c-35afc785980b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.443167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1cab5-de8c-4cb0-950c-35afc785980b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.443439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1cab5-de8c-4cb0-950c-35afc785980b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.444929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 367/732] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:53.445680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1cab5-de8c-4cb0-950c-35afc785980b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.508443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.514420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aaf2b-8f2f-4ab6-af6f-60f4f77b1aee None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.557206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.558392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.558822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.559295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.560272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:53.561055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:53.563676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5c6d8-c92e-4d66-944a-6cadd9c733fd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:53.570754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.577178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 366/733] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:53.578882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63889af-47da-4d25-b245-5c0ff151de0f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.579444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63889af-47da-4d25-b245-5c0ff151de0f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.579861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63889af-47da-4d25-b245-5c0ff151de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.584054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1cab5-de8c-4cb0-950c-35afc785980b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.600875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a63889af-47da-4d25-b245-5c0ff151de0f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:53.602092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a63889af-47da-4d25-b245-5c0ff151de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:53.619927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.620521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.620794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.621059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.621762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:53.622089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:53.623510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:53.640184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 368/734] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:53.640962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.667644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 367/735] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:53.668799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dae72-ba23-4f0c-9cca-49d04e656999 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.669082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dae72-ba23-4f0c-9cca-49d04e656999 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.669351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dae72-ba23-4f0c-9cca-49d04e656999 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.670650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 368/736] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:53.671910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dae72-ba23-4f0c-9cca-49d04e656999 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.754284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.757760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01d1d-7a6f-4fca-ae65-bf1d259e1616 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.776738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dae72-ba23-4f0c-9cca-49d04e656999 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.799112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.799747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.800026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.800295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.806513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:53.812721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.812857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:53.813348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.813626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.813896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.814290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:53.823963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-06240104-c1d7-49be-8b70-f0adecc56091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:53.828953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:53.829897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:53.831048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:53.831702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:53.832617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:53.833524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:53.833524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:53.833524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:53.833524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 369/737] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:53.833524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.839395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 369/738] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:53.839640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.840005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.840279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.859373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:53.860546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:53.932005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 370/739] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 07:14:53.932767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:53.939953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e60d-f688-47e2-a125-26ae52a08b2f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:53.974845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:53.975450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:53.975730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:53.975995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:53.997465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.036277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dceca-0e86-4a39-8129-832ccae8dc41 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.048879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.050360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.057773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.075249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.075918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.076204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.076477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.077670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:54.077980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.079348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.090617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 371/740] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:54.091409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.157372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 370/741] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 07:14:54.158423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.202483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59fb71-4a32-4071-a432-5024f5e9e332 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.211165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.235983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.236586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.236891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.237167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.238120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:54.238420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.239776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.247656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 372/742] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:54.248424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.262861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d5220-f4d0-4158-82b3-b0096d90b012 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.290994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.298467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.299068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.299341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.299611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.300242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.301610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.322025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 371/743] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:14:54 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:54.322025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.358430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fd07f-0118-4721-a1a3-8da739193eb3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.409724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.410402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.410682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.410952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.419566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.421135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:54.434252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:54.435296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:14:54.436804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:54.438117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a399f5-5071-4dd0-a8f4-5295f9be34dd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.443523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 373/744] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:54.443523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.457285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.484578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.486030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.486313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.486584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.500663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.502132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:54.517761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:54.518801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:54.519707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:54.519707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:54.519707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:54.519707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 372/745] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:54.519953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.554074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.558270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dcdd4-5ed2-4652-85e5-cfd7fe554a0a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.595599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.596212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.596491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.596762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.597403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.599121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.615065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 374/746] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:14:54 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:14:54.615743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.647823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade5198-c3ee-49c5-9569-1e67fe0d8806 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.714852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.715425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.715703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.715970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.733569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.735823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.745908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289596e-94ae-4dc3-a791-5c8a3d24321e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:54.757162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:54.758225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:54.759433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:54.759433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:54.759433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:54.759433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 373/747] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:54.759829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.783771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.799679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.799679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.799679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.799679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.800140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:54.800140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.800956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.820252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 375/748] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:54.821080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.850446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:54.884612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae82ce-cbbe-4c97-a2df-b3864db3b745 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.921151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.922249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.922830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.923299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.924149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:54.924647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.926466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.940220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 374/749] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:54.945231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e4f3-8108-46c0-a9f2-0b7b16786f61 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:54.946518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:54.979702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:54.980284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:54.980558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:54.980824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:54.981514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:54.981881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:54.983907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:54.997171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 376/750] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:54.998237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.023509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.054066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b80f6a-85b4-4a50-80bc-477510ca2117 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.089181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.090236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.090747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.091238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.169125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.171604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.204444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.231498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545825-c1df-484c-a74c-fb0d6c0918df None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.245626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.271022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.271655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.271979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.272245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.278185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 375/751] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:14:55.279286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.284771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.286266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:55.299133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:55.300078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:55.300983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:55.305114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 377/752] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:55.305775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.408054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035774-c216-473a-af76-0fc733804d29 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.425285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b57360-5a03-400d-8030-7a92a8b5d6ad None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.445805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.446937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.447307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.447674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.458927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.460995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.469501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.470166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.470445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.470715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.473447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:55.475143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:55.476324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:55.477302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 376/753] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:55.479092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.489464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.491368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:55.508394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:55.509382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:55.510996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:55.510996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:55.510996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:55.514154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 378/754] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:55.515037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.519994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.593767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea65eed-5784-4b3a-be4d-403fa66a3e59 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.616542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d51fa-5c83-4856-bac5-d5ec4378c900 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.631762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.632838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.633327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.633858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.634789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:55.635344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.637082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.651017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 377/755] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:55.652269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.662837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.663448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.663721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.663986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.665071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:55.665386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.667171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.693755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 379/756] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:55.693755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.759172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.761721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:55.772621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5bd06-7064-41ee-8bec-8ce0ade97fc8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.812909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.813882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.814394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.814897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.815850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:55.816373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.818134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.829855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1db71-1b19-4fa2-9ff7-d7cc151ecc08 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.831751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 378/757] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:55.833035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.871893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:55.872499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:55.872777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:55.873047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:55.874337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=89eb038259df4fbab0b03d2157e3d55c) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:55.874644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:55.876075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:55.883331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 380/758] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/role_assignments?user.id=89eb038259df4fbab0b03d2157e3d55c&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:55.884145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:55.965265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84c3c8-b618-4104-84a5-d12d4227f18c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:55.995726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d30-5ae1-4d69-a731-731343866fb9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.008286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.014043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.016722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.019255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.020656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.042309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.045488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.062046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.063057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.065178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.065695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:56.078954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:56.079978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:56.080914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:56.080914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:56.080914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:56.083952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 379/759] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:56.084649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.086459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.090415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.094846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:56.101870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:56.102812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:56.103736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:56.106137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 381/760] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:56.111971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.218470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4297-7962-41f4-9c5a-ed10e0934065 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.256507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.257572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.258083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.258558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.259444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:56.259969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.261644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.275019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 380/761] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:56.282876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.340425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d6007-200d-45e6-97bb-e65f4aff48ef None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.378865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.381161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.381770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.382076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.382346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.383040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:56.383340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.385651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd903f45-c21c-49cf-8ed0-c7655a89b094 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.400996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 382/762] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:56.402381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ece2-adc8-4dc2-8a6d-616cfeac0383 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.402761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ece2-adc8-4dc2-8a6d-616cfeac0383 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.403040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245ece2-adc8-4dc2-8a6d-616cfeac0383 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.408484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 383/763] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:56.409282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245ece2-adc8-4dc2-8a6d-616cfeac0383 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.419634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48308811-00cd-4e2f-b78e-9a82d0373c0e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.442806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.459385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.460029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.460308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.460705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.468214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.469728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4233e516-3917-416f-a6de-3cfd4a9e22a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:14:56.481831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:56.482748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:56.484199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 381/764] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:56.489514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782ba8-cd80-4c31-9ee2-a5d5400a5300 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.489514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782ba8-cd80-4c31-9ee2-a5d5400a5300 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.489514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe782ba8-cd80-4c31-9ee2-a5d5400a5300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.505403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fe782ba8-cd80-4c31-9ee2-a5d5400a5300 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:56.506772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fe782ba8-cd80-4c31-9ee2-a5d5400a5300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:56.519164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245ece2-adc8-4dc2-8a6d-616cfeac0383 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.555101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.555624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.555898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.556165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.556881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=8499dabf82534db393da7811d003c4c7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:56.557183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.558634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.564489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 384/765] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:14:56 2022] GET /identity/v3/role_assignments?user.id=8499dabf82534db393da7811d003c4c7&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:56.565281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.579953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 382/766] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:14:56.721841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1948a-2a03-4f4a-8159-3874ef5594b1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.723457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.760511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.761173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.761451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.761715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.762440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:56.762737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.764161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:56.777098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 385/767] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:56.778646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4f7b8-b4b3-4ef8-b156-e4d7b1dffdbc None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.778945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4f7b8-b4b3-4ef8-b156-e4d7b1dffdbc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.779441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4f7b8-b4b3-4ef8-b156-e4d7b1dffdbc None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.780923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 383/768] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:56.783273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:56.789043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.789043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.789043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.823620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:56.824719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:56.919202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:56.949727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e5e8a-9502-485f-b57d-29a519aa4a8e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:56.953466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 384/769] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:14:56.991898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:56.992894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:56.993366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:56.993866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:56.996140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=36a43ff4bca2482d871b6f8b7dec3a02, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:56.997754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.013403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 386/770] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:14:56 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:14:57.029356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.162957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86273ab3-8a34-4dfc-874b-0a4c06afc3ed None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.200246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.200875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.201151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.201420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.202066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.203447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:57.212311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:57.213321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.214203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 385/771] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:57.219266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.240248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:57.330728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.335921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b1434-3ffc-49f2-9b9c-7e6baa841196 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.379416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.380349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.380854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.381325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.382182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:57.382709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.385348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.397656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 387/772] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:57.403168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.419471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:57.517942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd50e5-4297-40df-bef4-fbf16a808e13 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.556871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:57.586990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.588015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.589520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.590032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] PATH_INFO: `/v3/services/network` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.591505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.593250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.596498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8612cd-87ae-4bd7-b7e7-f6d608062af1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:57.607281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:57.608380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:14:57.609234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:57.618197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 386/773] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services/network => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:57.623098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.670814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.671353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.671631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.671899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.672534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:57.672829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.674232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.685255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 388/774] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:57.694994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.742551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a515b-4545-4000-8d5d-1d24a707e587 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.757391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:57.784118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.785100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.785575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.786076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.787003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] RBAC: Adding query filter params (name=network) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:57.787498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.789077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.794603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 387/775] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:57.805951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.874482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53023ed2-d566-429c-bf0b-eb87d28ddbb0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:57.907407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:57.907953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:57.908233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:57.908502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:57.909202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] RBAC: Adding query filter params (interface=public, service_id=bea442b4650d499d85d37d3e53d7bdc5, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:57.909503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:57.910901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:57.918599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 389/776] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/endpoints?service_id=bea442b4650d499d85d37d3e53d7bdc5&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:57.924446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:57.958556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:58.024505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c1739-61d6-49d0-a0b9-675e20d4704f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:58.052639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d62443-4c4d-4869-952c-c0da5b14dc59 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:58.087795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:58.088646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.089071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.089487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.090398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] RBAC: Adding query filter params (type=network) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:58.090677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:58.091015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:58.091300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.091576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.091843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.092985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:58.093703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:58.094359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e5cb2-7832-4adf-9a62-1d4d41d340ae None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:58.100424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 388/777] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:58.106363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 390/778] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:14:57 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:14:58.107897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:58.166565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761abc-374e-4c90-a088-3edf756b9a5c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.167211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761abc-374e-4c90-a088-3edf756b9a5c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.167682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f761abc-374e-4c90-a088-3edf756b9a5c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.169565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 391/779] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:58.174941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:58.176175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.176665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.177124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.196134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:58.197686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:58.243671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea072-90fe-44a9-8f84-678a360a2b62 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:58.284744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:58.291095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:58.292045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.292534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.294002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.294127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 392/780] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:14:58.298888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] RBAC: Adding query filter params (interface=public, service_id=d6d5858f328a4b43ba2bd7c80dcbcd22, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:58.299430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:58.301013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:58.309830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 389/781] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:14:58 2022] GET /identity/v3/endpoints?service_id=d6d5858f328a4b43ba2bd7c80dcbcd22&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:58.315890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:58.448777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7a8f-2254-40a2-ba6d-625091719fbb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:58.483689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:58.484298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.484574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.484839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.485441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:58.486841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:58.496180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 393/782] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:14:58 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:58.611730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:58.720645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e023ef1-c60d-4def-82b0-7e031471b2da None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:58.723369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:58.762065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:58.762704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.762979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.763247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.777892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-74ad33e1-b846-4d6d-9758-f44af28485ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:58.785235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:58.786237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:58.787724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 390/783] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:58.793024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:58.863187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:58.885631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdaef2-03a3-4eb6-ba3c-d286c3eec0fb None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.886302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdaef2-03a3-4eb6-ba3c-d286c3eec0fb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.886789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdaef2-03a3-4eb6-ba3c-d286c3eec0fb None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.889637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 391/784] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:14:58.893889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:58.894414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:58.894892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:58.914824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:58.916766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:58.933723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfff15e-1c13-49d4-baaa-5990af79f415 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.005030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.006542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.007573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.008776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.010430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:59.010941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.018075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 392/785] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:14:59.019802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.030514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 394/786] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:59.035611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.172886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:59.179515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc4908-6c0f-44f2-8ee8-78bccd88530a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.223580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.224205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.224480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.224748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.240230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.241662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-36e49d84-fb07-4bb2-8c8c-17580479e4f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:14:59.260074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:59.261029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:14:59.262664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:14:59.262664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:14:59.262664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:59.262664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 393/787] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:59.267587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.328738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6355a-8e73-4e82-9334-b177bbdee7e3 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.329044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6355a-8e73-4e82-9334-b177bbdee7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.329284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6355a-8e73-4e82-9334-b177bbdee7e3 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.330634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 394/788] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:14:59.335653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.335931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.336196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.362667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:14:59.364113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:14:59.395959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba3a56-3fab-4fde-af80-12d7d8e14a02 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.431031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:59.442078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.442941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.443391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.443861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.444678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:59.445158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.446811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.455864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 395/789] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:14:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:14:59.456866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.469488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 395/790] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:59.475090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.615432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:59.651736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3761d-c7c9-4932-8993-fc7a5abd9e78 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.680079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a2071-72ad-4a73-9057-7b64e1ff102e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.685513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.686707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.686986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.687253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.694358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.695795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:14:59.715587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:59.716628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:14:59.717634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 396/791] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:14:59.722307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.729739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.730418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.730693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.730964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.741271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:14:59.745997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:14:59.746920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:14:59.747767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 396/792] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:14:59.758837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.788690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:59.848736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe4ca1-951f-4c3a-9732-751a1420617c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.892900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.893432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.893712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.894063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.894511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9e0f-77d5-40e9-9b58-fe1fdefaf521 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:14:59.894800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:59.895127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.896567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.919079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 397/793] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:59.919982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:14:59.941007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:14:59.941779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:14:59.942197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:14:59.943098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:14:59.943876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:14:59.944509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:14:59.946278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:14:59.949890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:14:59.965186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 397/794] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:14:59.966239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.038995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ab058-8b0e-4d73-9158-b05b66ccda0b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.042186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.086836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae1c05-daa4-4b9c-8565-e45db0d17b15 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.087174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.087822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.088100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.088371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.102596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:00.107827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.109718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:00.111775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:00.121988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 398/795] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.121988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.128065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.128861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.129551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.129832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.144842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.147096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:00.163995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.166157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:00.168253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:00.168253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.168253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:00.173985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 398/796] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.173985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.223270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.235689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47337aef-1692-4bff-b1aa-0bcfdb7ae6b8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.278263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727781-8d25-4df1-a142-d4cafbdeae0b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.281367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.282849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.283132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.283470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.296471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.298129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.316386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.317280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.317772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:00.318165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.319103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:00.320032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:00.320032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.320032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:00.320846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.321705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:00.322223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.323781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.323986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 399/797] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.324899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.334323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 399/798] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:00.339714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.347636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.454706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a70985-3c6a-4077-bcb3-6a27a0192a63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.461029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bff81-1f75-49d4-af5e-b0c773658c46 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.474475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.488408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.489016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.489295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.489567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.490268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:00.490570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.491969 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.498166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.499300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.499575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.499846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.500475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:00.500771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.502161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4671854-310c-4e6c-8a2e-1ff50c9af132 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.509119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 400/799] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:00.509119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.518049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 400/800] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:00.519141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8193f-be08-4604-9269-2ec3ce312285 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.519430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8193f-be08-4604-9269-2ec3ce312285 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.519701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8193f-be08-4604-9269-2ec3ce312285 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.522029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 401/801] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:00.522029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8193f-be08-4604-9269-2ec3ce312285 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.594202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.617892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014db41-811a-45dc-a741-d9554e657c55 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.635775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8193f-be08-4604-9269-2ec3ce312285 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.653129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.653804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.654113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.654383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.665174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.666643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.669253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.669867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.670168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.670464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.676848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.678290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:00.681833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.682925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:00.683846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:00.683846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:00.683846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:00.688127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 401/802] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.688127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4200e389-d7fd-4aa7-976c-993b43790231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:00.691011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.691933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:00.692885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:00.696843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 402/803] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.698147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.698432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.698701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.717593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:00.718962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:00.747544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.793003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7494b2-6e39-413d-8d3e-418207d794df None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.794774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 403/804] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:00.795572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.837821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:00.848131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.848763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.849045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.849313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.856976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.858516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:00.870331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:00.871454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 402/805] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:00.872430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.926622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223851d-e31a-40a2-98fa-84f22dca9864 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:00.961275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:00.962129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.962411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.962679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.963318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:00.963624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:00.964971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305fde-e84f-4a5f-bb3b-25e6b2bfdf48 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:00.976924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 404/806] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:00.978125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada352b5-71c6-47de-bd6a-1f904a292fb5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:00.978411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada352b5-71c6-47de-bd6a-1f904a292fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:00.978687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada352b5-71c6-47de-bd6a-1f904a292fb5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:00.982003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 405/807] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:00.982003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada352b5-71c6-47de-bd6a-1f904a292fb5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:00.983841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2070e6b-78b3-4996-8599-2265d15433da None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.016701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.018595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.019167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.019481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.019771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.020491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:01.020797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.022259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.035154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 403/808] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:01.035957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.084366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.105275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada352b5-71c6-47de-bd6a-1f904a292fb5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.133629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab424-b999-42e4-9346-2e9a8d7cb880 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.138436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.139036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.139931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.140194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.140899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:01.141204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.142641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74161b-4125-4f48-84b2-f3c62911faf7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.159534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 406/809] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:15:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:01.160767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.161058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.161332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.166873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.167497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.167775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.168044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.175001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.176434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.178424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:01.179611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:01.188866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:01.189814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 404/810] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:01.190821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.251055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 407/811] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:01.251720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.265489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.296980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194e1aa-7f41-43bc-a3ec-705633e1d704 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.307829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.340079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.340737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.341272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.341272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/89eb038259df4fbab0b03d2157e3d55c/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.343248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=89eb038259df4fbab0b03d2157e3d55c, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.344670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.357268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0e9ca-7321-4b05-be52-3c2c75058368 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.360384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 405/812] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:01 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/89eb038259df4fbab0b03d2157e3d55c/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:15:01.361017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.399973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.400619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.400892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.401155 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.401806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.403275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:01.413347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:01.414482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:01.415357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 408/813] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:01.416194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.503827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.523847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07beaa-88d1-4557-bd8e-72566a5655d6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.535146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225020ff-3e81-4371-ae59-268824de7d25 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.563992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.564714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.564988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.565260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.571833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.572428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.572703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.572971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.573680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:01.573992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.575419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.577560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.579270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.593760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 409/814] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:01.593945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:01.594866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:01.595788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:01.595788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:01.595788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:01.595962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.596040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 406/815] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:01.596040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.626051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.707715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5d427-7818-46e6-92da-9ba0ec928aa6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.708051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5164b-f879-4a35-be7c-e34dd9e8d60b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.739589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.743301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.743737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.744004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] PATH_INFO: `/v3/services/network` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.744581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.745905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.746063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.746546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.746828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.747101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.747849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:01.748151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.749633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.758674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 410/816] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:01.758813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:01.759760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 07:15:01.760620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:01.761377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.761448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 407/817] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:01.761448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.849501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.867292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9fcfb-7f43-4fd8-830c-5133e262f481 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.867460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44dcb8-c2af-41a5-a57f-dc703ed8ef62 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:01.902674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.903275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.903516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:01.903661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.903842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.904116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:01.904392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:01.904488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:01.904661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:01.904781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.906196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:01.918590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 408/818] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:01.922921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:01.972295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:01.980854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:01.982342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.027989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5b852-9f57-4b42-81f7-8445273761ca None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.062340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.063228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.063754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.064230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.064958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:02.065357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.066853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.071766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 409/819] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:02.072708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.086144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.099011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 411/820] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:02.099011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.182495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c006d66-65f8-4387-8ecf-060e38bc4e39 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.199895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.207205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52517-39ab-4ad3-b709-54c23d1268a2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.222524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff40b-8056-4301-915f-394651139198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.223133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff40b-8056-4301-915f-394651139198 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.223411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff40b-8056-4301-915f-394651139198 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.223680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff40b-8056-4301-915f-394651139198 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.224311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff40b-8056-4301-915f-394651139198 None admin] RBAC: Adding query filter params (name=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:02.224610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff40b-8056-4301-915f-394651139198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.225999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff40b-8056-4301-915f-394651139198 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.230615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 410/821] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:02.231394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff40b-8056-4301-915f-394651139198 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.249304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.249929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.250237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.250505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.257176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.258657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:02.269601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:02.270745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:02.271687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 412/822] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:02.272186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.307629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.341597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff40b-8056-4301-915f-394651139198 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.383140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.383781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.384060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.384327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.385002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.386449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.418001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 411/823] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:02.418001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.501118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384ac92-8f97-41e8-b4bf-eac4d59a6e72 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.542837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.543583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.543853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.544219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.552203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ef7a-249c-433f-be34-1f5f6700b80d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.555820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.557473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:02.574197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:02.575224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:02.576167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:02.576167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:02.576167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:02.580083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 413/824] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:02.581032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.586734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.595428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.613151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.613772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.614232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.614499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.615246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] RBAC: Adding query filter params (type=network) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:02.615545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.616908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.624533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 412/825] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:02.625126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.708027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5866-12ba-41a4-b805-9155a37a3a18 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.749154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5311e-8f52-4c4c-873a-de43553b0255 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.753041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.753646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.753919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.754205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.754945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:02.755242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.757157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.774050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 414/826] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:02.774892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.795213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.796637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.796916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.797185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.798005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:02.798308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.799969 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.818042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 413/827] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:02.819005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:02.851218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.886997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae78b5-a5f3-4a5a-bb9f-576beaf98e1c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.888222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:02.928792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:02.929505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:02.930011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:02.930362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:02.931411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:02.932847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:02.948780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dda8c-cbc0-4b46-8cfb-efe54fe334b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:02.960236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 415/828] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:02.961442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:03.009192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:03.011342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.011739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.012439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/8499dabf82534db393da7811d003c4c7/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.053468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=8499dabf82534db393da7811d003c4c7, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:03.056616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:03.080740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 414/829] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:02 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/8499dabf82534db393da7811d003c4c7/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:15:03.135503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ea6c-9a67-48a0-afc8-6cfb22c41f1c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:03.158871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:03.176742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:03.177605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.178085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.178589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.186481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:03.187953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-19f1a866-8e1b-4ba3-a9e2-c12be3eaa4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:03.200467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:03.202459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:03.203380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 416/830] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:03.211119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:03.280779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03bdb-c091-43b9-b86a-52d0828f8586 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.281102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03bdb-c091-43b9-b86a-52d0828f8586 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.281322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea03bdb-c091-43b9-b86a-52d0828f8586 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.283220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 417/831] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:03.288439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.288720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.288990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.308763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:03.310089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:03.325998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:03.331160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8903bb2-ef3f-433c-83f5-65352031f492 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:03.376792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:03.377767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.378312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.378777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.379658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:03.380169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:03.381800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:03.394865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 415/832] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:03.400884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:03.401625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 418/833] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:03.504601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87aa32-1b77-4e80-907a-8b1d41720452 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:03.539588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:03.540193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.540467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.540734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.541454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:03.541752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:03.543202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:03.549498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 416/834] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:03 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:03.708210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:03.813392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee98fa8-d492-4b1c-a5d9-9fb4baef8052 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:03.824238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:03.849572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:03.850232 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:03.850502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:03.850763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:03.861262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:03.866125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:03.867041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:03.867898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 419/835] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:03.873267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:03.898976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:03.980266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065bb9a-3596-40ae-b93b-0ff83cc021e6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.015434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.016047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.016322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.016590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.017247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:04.017543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.018931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:04.027533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 417/836] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:04.033172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.140178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819645cb-5bbd-40a6-848e-a43e1206f534 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.175875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.176858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.177350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.177814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.188395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.190110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:04.204985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:04.206419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:04.207323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:04.207323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:04.207323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:04.209391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 420/837] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:04.217989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.307875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:04.324036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbe786-4bf4-46f5-8b37-6571b5b683b4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.359401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.360057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.360335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.360603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.361246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:04.361543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.363179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ade4c-9111-45e9-ba7d-cc3bcfb16179 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:04.375411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 418/838] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:04.381000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.407024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:04.484370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d99bc-39d5-46ae-a5bf-44761ee5a759 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.518893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.519548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.519820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.520096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.529192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff71d-59ad-4bfa-a7df-e1a6084e207e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.529468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff71d-59ad-4bfa-a7df-e1a6084e207e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.529768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ff71d-59ad-4bfa-a7df-e1a6084e207e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.530320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.531439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 419/839] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:04.531785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:04.539314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.539871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.540345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:04.549657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:04.550756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:04.551767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 421/840] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:04.558060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.567175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:04.569151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:04.647257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:04.662991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 420/841] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:04.672849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8548f-b5ed-4dd9-81da-d04af6dd4744 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.706931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.707772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.708191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.708627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.709489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:04.709993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.711590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:04.731278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 422/842] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:04.742017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.818937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:04.844880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544174f0-8ee4-4b49-bcd5-2cc068b9de90 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:04.879603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:04.880211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:04.880481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:04.880745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:04.939384 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:04.948547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:04.950015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.026126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.053459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b2ed-11ec-4728-8aef-f787467954e7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.056856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 421/843] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:05.057852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.091352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.091894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.092202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.092464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.093034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.094430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-05368bbf-4afa-4585-b889-9996de296545 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:05.103007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:05.104027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:05.104909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 423/844] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:05.106231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358059-2eb0-4708-b830-84dd576484c9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.106231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358059-2eb0-4708-b830-84dd576484c9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.106231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358059-2eb0-4708-b830-84dd576484c9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.111044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 424/845] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:05.111044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358059-2eb0-4708-b830-84dd576484c9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.113521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.171344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3275d74-f664-4242-80c4-c8a21823b39c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.207128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.207748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.208020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.208284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.218462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.219050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358059-2eb0-4708-b830-84dd576484c9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.219904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c4a7ed3f-20b2-4122-8318-fdf109e9262e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:05.235237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:05.236227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:05.237151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:05.237151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:05.237151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:05.241148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 422/846] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:05.242285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.242565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.242834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.257386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.258008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.258287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.258553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.259168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:05.259463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.260808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.260908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:05.262097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:05.270929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 425/847] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:05.270929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.283509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.332896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 423/848] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:05.333735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.344825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.390315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582370-31f9-4bd1-b731-95d769096b8d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.426887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.427487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.427760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.428027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.428719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:05.429018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.430408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.447278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 426/849] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:05.448690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.475031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d50e1-789e-4929-96e8-9f3f1b2deba2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.510507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.511114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.511385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.511911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.512270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:05.512563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.513955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f48445-296d-4d76-8fa8-3a29e8fbbf2e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.518722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 424/850] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:05.563465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc6c7-898b-4bee-baea-305d661d600f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.595302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.606290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.607323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.608371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.608840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.617116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.618970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:05.631601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:05.632585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:05.633590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:05.635566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 427/851] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:05.636542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9144b-e32b-42a7-b6fb-738eec50b682 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.638230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9144b-e32b-42a7-b6fb-738eec50b682 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.638770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9144b-e32b-42a7-b6fb-738eec50b682 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.640958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 425/852] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:05.641882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.642833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9144b-e32b-42a7-b6fb-738eec50b682 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.668478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.750581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb83d8-2460-4350-8bca-37075574aac3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.765995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9144b-e32b-42a7-b6fb-738eec50b682 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.787883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.788838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.789122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.789659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.799524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.800130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.800405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.800671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.801355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:05.801655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.802701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:05.803233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7fcb22ad-f2ce-4d5e-b192-336a2aa0ca53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:05.808673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:05.809611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:15:05.810515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:05.811765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 428/853] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:05.811942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.812229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.812567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.818224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 426/854] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:05.819282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.831176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:05.832372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:05.879745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.904081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 429/855] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:05.905722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:05.916643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:05.939253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114236d0-6045-439e-ab18-c1da4bc7edad None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:05.979807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:05.981429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:05.981883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:05.982361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:05.983309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:05.983769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:05.985395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:05.997374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 427/856] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:06.003106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.012075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2498d27-1ac3-42c1-8e0f-8e54ac4a532f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.052034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.052873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.054339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.054716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.055584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=89eb038259df4fbab0b03d2157e3d55c) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:06.055991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.058058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.067101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 430/857] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:05 2022] GET /identity/v3/role_assignments?user.id=89eb038259df4fbab0b03d2157e3d55c&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:06.131344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124789-2d97-437e-8551-d6acb46fed04 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.170865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.171796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.172238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.172661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.185442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.187823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.190292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.190648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:06.208759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:06.209775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:06.210712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:06.210712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:06.210712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:06.211315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 428/858] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:06.216379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.249317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.333448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4511-10ac-4716-96a8-62e61d7b3d55 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.336027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c939013-d85d-4049-bd7e-0a7593ac0aa7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.383481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.384030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.384303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.384567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.385141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.386571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.389691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.390838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.391341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.391814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.392664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:06.393189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.394797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:06.395693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:06.396667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:06.398191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 431/859] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:06.402821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.422347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 429/860] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:06.428212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.487104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.512787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb961d-db00-4392-bbe0-d7543e7eec93 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.520755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.537423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f72059-2b61-42c1-868a-e17708ee36cb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.550917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.551571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.551819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.552089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.552711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:06.553005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.554414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.564412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 432/861] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:06.565295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.582341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.583790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.584063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.584325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.595358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.598077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:06.614720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:06.615792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:06.616781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:06.620641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 430/862] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:06.621522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.686541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394db87-4185-4315-baec-b035f0ddc732 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.726145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.727157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.727640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.728113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.729073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:06.729652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.731371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.737836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 433/863] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:06.757343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fc27-c85d-4b70-aae2-ec26efb51c63 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.774040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.798230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.799303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.799834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.800320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:06.801298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:06.801839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:06.803725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:06.824772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 431/864] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:06.830741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:06.868572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:06.948758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b828f-d027-4ee9-ba96-ee667f8d4a72 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:06.984599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:06.985576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:06.986088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:06.986559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.057036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.058573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:07.093448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:07.168406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 434/865] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:07.174683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.284851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830fcb-5f57-4dfc-8f1b-ab5431985f03 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:07.320491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:07.321117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.321395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.321663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.332620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.334156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6369e77c-af2a-4438-b5f3-1d79f2fdfefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:07.351841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:07.353615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:07.354585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:07.354585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:07.354585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:07.354585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 432/866] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:07.361163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.440075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1f9a-98cb-417c-92a3-bce0d433e236 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.440392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1f9a-98cb-417c-92a3-bce0d433e236 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.440627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b1f9a-98cb-417c-92a3-bce0d433e236 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.445798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 433/867] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:07.447020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.447302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.447573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.468409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:07.469580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:07.476122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bae9b-e7c6-4977-88fb-c069d9eeb105 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:07.489633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:07.514717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:07.515318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.515591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.515854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.516485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:07.516775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.518587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:07.520803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:07.540733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 435/868] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:07.542581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.552225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 434/869] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:07.652688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b75204-8fe6-45ac-b6a0-b6ce9329753b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:07.688354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:07.689343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.689826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.690336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.697544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.699272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:07.710989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:07.711888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:07.712808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:07.715137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 436/870] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:07.721424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.819156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.832581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6cdc-8ab1-498a-9a13-36646d43915e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:07.872832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:07.873898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.874406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.874892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.875781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:07.876281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.877923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:07.890490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:07.892487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 435/871] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:07.898537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:07.917569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:07.951128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d2138-8b16-4976-8103-573d70fc8922 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:07.986640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:07.988010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:07.988498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:07.988967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:07.989890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:07.991502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377de4-8d25-4731-93e2-e5e2116f7e0d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:08.013239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 437/872] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:07 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:08.027690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46f31-0aa3-4cb5-b71a-081fa77245c6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:08.050595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53340b-3a15-4251-8b2f-a797d84370cd None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.051264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53340b-3a15-4251-8b2f-a797d84370cd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.051752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53340b-3a15-4251-8b2f-a797d84370cd None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.053826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 438/873] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:08.059150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc545-2a35-4260-a7a2-33534355966d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.059718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc545-2a35-4260-a7a2-33534355966d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.060409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc545-2a35-4260-a7a2-33534355966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.079740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:08.080275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.080959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.081238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.082003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=8499dabf82534db393da7811d003c4c7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:08.082300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:08.083755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:08.086545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-137bc545-2a35-4260-a7a2-33534355966d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:08.089150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-137bc545-2a35-4260-a7a2-33534355966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:08.090854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 436/874] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:07 2022] GET /identity/v3/role_assignments?user.id=8499dabf82534db393da7811d003c4c7&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:08.177046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 439/875] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:08.443093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:08.527737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:08.556277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dc2ee-0a05-4431-8650-ce31a26b6a76 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:08.592460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:08.593460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.593949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.594448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.595219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:08.596808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a5090c14-36a3-4318-af07-4b834125d817 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:08.606154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:08.607163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:08.608073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:08.610807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 437/876] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:08.616587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc545-2a35-4260-a7a2-33534355966d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:08.664859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:08.726446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc545-2a35-4260-a7a2-33534355966d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:08.735684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a5da-4c7c-4da1-b952-cebbda817a2a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.735959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a5da-4c7c-4da1-b952-cebbda817a2a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.736240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013a5da-4c7c-4da1-b952-cebbda817a2a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.741617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 438/877] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:08.743073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.743354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.743624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.761983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:08.763221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:08.768736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:08.769564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.770069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.770557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.771881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:08.772382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:08.774422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:08.782251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 440/878] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:08.791470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:08.850099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 439/879] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:08.907709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632e2bd-e0db-4d98-9c58-a85af6e7a18b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:08.917035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:08.944650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:08.945560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:08.946088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:08.946551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:08.947394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:08.947893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:08.949436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40be670-8432-4da3-a610-61905c49f8a5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:08.955342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 441/880] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:09.125991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:09.198040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:09.234619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5831c83-b0b6-4d17-bf8e-918691c3b212 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:09.269608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:09.270267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:09.270540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:09.270805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:09.271464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:09.272882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81369-6f54-4fa8-82f7-a52280509e0e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:09.290529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 440/881] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:09 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:10.016001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412f9b-0be7-477d-ac1e-85a3baf65e62 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.016555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412f9b-0be7-477d-ac1e-85a3baf65e62 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.016555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412f9b-0be7-477d-ac1e-85a3baf65e62 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.018168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 442/882] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:10.023289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309d06-62c6-421a-8019-75bf3e081ec6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.023672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309d06-62c6-421a-8019-75bf3e081ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.023850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70309d06-62c6-421a-8019-75bf3e081ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.042216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-70309d06-62c6-421a-8019-75bf3e081ec6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:10.043399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-70309d06-62c6-421a-8019-75bf3e081ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:10.119420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 441/883] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:10.122466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178776-bd82-474b-aba7-983eded6c60e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.122745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178776-bd82-474b-aba7-983eded6c60e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.123010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178776-bd82-474b-aba7-983eded6c60e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.124582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 443/884] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:10.129626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.129910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.130208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.148213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:10.149378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:10.201692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:10.219286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 442/885] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:10.387052 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178776-bd82-474b-aba7-983eded6c60e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.487179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.489567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178776-bd82-474b-aba7-983eded6c60e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.527001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:10.527624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.527901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.528337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.529170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:10.531286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:10.540762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:10.541748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:10.542650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 444/886] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:10.548020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.585548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:10.592991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1a6e8-ca51-4ea5-be67-1142c937f72c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.628660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:10.629571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.630525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.631092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.644779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:10.650877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:10.651829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:10.652689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 443/887] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:10.659639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.664475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dd0d8-5fb4-4846-9e98-07353fd25bc8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.703913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:10.704514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.704792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.705101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.705727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:10.706057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:10.707527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:10.712936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 445/888] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:10.721760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.723971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:10.798265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea00f1-4dda-4aed-bb90-2a97e485e187 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.841820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:10.842538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.842813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.843128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.843794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:10.844087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:10.846205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:10.855428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:10.861455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 444/889] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:10.862660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.863891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1402c-8c59-480a-a6d4-309ee6b64877 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.905816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:10.906370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:10.906642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:10.906908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:10.907535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:10.907828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:10.909905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:10.919124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 446/890] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:10.920183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:10.987142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b7345-c999-407f-9786-5220280d3f8c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:10.995500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.024917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12a37-9c3d-4772-b25c-7bbc52a7110b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.027789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.028195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.028533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.028806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.039717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.041173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6160d48b-5a9a-4671-b0ec-d9569bbaf7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:11.056207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:11.057200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:11.058135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:11.058135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:11.058135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:11.058135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 445/891] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:11.058854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc192b5-cd96-44cc-b9bd-d62b55d7725b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.058854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc192b5-cd96-44cc-b9bd-d62b55d7725b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.059009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc192b5-cd96-44cc-b9bd-d62b55d7725b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.060352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 446/892] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:11.063326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc192b5-cd96-44cc-b9bd-d62b55d7725b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.065458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.066373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.066666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.066942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.068545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] RBAC: Adding query filter params (interface=public, service_id=f4f5dfa491fc4632a48316e06d5619af, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:11.068849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.070238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2da7a0-7622-4815-82c8-01fe9a7db475 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.077392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 447/893] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:15:10 2022] GET /identity/v3/endpoints?service_id=f4f5dfa491fc4632a48316e06d5619af&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:11.081832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.081832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.081832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.099270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:11.100436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:11.125323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.170769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 448/894] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:11.171187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc192b5-cd96-44cc-b9bd-d62b55d7725b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.172076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.220155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.220671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.220951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.221221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.221994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:11.222205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.223580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb021d-be80-4191-973f-6211d70e34b8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.239877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 447/895] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:11.239877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0605c-1006-4fce-958a-9c6d592a1390 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.239877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0605c-1006-4fce-958a-9c6d592a1390 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.239877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0605c-1006-4fce-958a-9c6d592a1390 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.239877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 448/896] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:11.241706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0605c-1006-4fce-958a-9c6d592a1390 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.263208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.286106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ffe0-6f26-474a-b6be-6ff165ea6f92 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.323412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.324010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.324286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.324553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.325148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.326554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002aaab7-2c2f-4530-815c-e918bc240b60 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.341998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 449/897] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:15:11.341998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30655ea-a960-4355-b66c-1e67707742de None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.341998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30655ea-a960-4355-b66c-1e67707742de None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.341998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30655ea-a960-4355-b66c-1e67707742de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.359866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b30655ea-a960-4355-b66c-1e67707742de None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:11.361354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b30655ea-a960-4355-b66c-1e67707742de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:11.378941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0605c-1006-4fce-958a-9c6d592a1390 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.380747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.423913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.424708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.425074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.425434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.434555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.436886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.441401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 450/898] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:11.451031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30655ea-a960-4355-b66c-1e67707742de None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:11.451386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:11.452334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:11.453406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:11.457319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 449/899] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:11.458328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.557879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.563146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30655ea-a960-4355-b66c-1e67707742de None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.581780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a43b6-1c29-47e6-ab9c-4fc5941cd094 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.598693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.599392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.599669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.599936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.600671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.602119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.620522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 451/900] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:11 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:11.634508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.635157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.635473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.635743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.636599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:11.636903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.638411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.660817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 450/901] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:11.666760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.685265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.724933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.797593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefb2b7-9006-43c6-830b-3d7f096edb39 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.849516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.850718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.851408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.851856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.858379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2a1fa-78c1-4b66-8ed9-460f2e6a5301 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:11.892103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:11.902264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755056c0-6094-42e3-a946-750259826825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:11.902977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755056c0-6094-42e3-a946-750259826825 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:11.903327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755056c0-6094-42e3-a946-750259826825 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:11.903661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755056c0-6094-42e3-a946-750259826825 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:11.904317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755056c0-6094-42e3-a946-750259826825 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.905860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755056c0-6094-42e3-a946-750259826825 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-755056c0-6094-42e3-a946-750259826825 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:11.914959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:11.915923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:11.916851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 451/902] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:11.921919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755056c0-6094-42e3-a946-750259826825 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:11.947507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:11.949608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:11.967785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.055251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755056c0-6094-42e3-a946-750259826825 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.077636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 452/903] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:12.083128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.096329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.097287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.097759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.098279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.099216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.099800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.101347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.107017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 452/904] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:12.113162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.190383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.199257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b759e27-2b11-43a1-9d33-71c0fcab961c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.215570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.244679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.245335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.245539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f14d8-e31e-4cfc-8a8a-b72bfaf83b13 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.245640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.245863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.261675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.263267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:12.278905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:12.279903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:12.281063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:12.281063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:12.281063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:12.281063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 453/905] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:12.285736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.286430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.287137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.287414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.287679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.288471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.288768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.290166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.296033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 453/906] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:12.301807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.396407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdb5ff-e41c-452d-b2a7-92ac8d3a33c2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.409611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f85d0a-a794-4419-a396-383fad9db1bc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.434230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.435270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.436681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.437107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.438062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.439281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.439728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.441388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.446853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.447535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.447883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.448225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.448992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] RBAC: Adding query filter params (interface=public, service_id=4c5ec4f4793e4fc1b5889298d6fbfe24, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.449421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.450832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.456802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 454/907] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:12.460992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 454/908] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/endpoints?service_id=4c5ec4f4793e4fc1b5889298d6fbfe24&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:12.462170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.462352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.491213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.566647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469356d-81cb-4d4a-a29c-6fa3759975d2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.577657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eafa2-6d46-4636-9691-5aef1e0955af None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.601764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.602344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.602621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.602891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.603496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.604858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.618079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 455/909] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:15:12.619020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.619956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.620439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.620916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.630002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.632019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:12.646799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:12.647865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:12.648815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:12.651401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 455/910] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:12.657041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.725362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.778091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f03b-5fb9-4691-8804-80af68559639 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.817085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.817730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.818034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.818309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.819025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.819328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.820791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157d84c-646e-4cf8-b500-3b9c2a39832a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.834427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 456/911] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:12.840287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:12.934024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:12.952312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4379ae0-52a9-4b4f-becd-8bb55f3733bd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:12.988805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:12.989325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:12.989601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:12.989869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:12.990688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] RBAC: Adding query filter params (role.id=ea49f084a93c4308be28d39e5a0ca80f, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=8499dabf82534db393da7811d003c4c7) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:12.990989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:12.992468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bddaf-1f89-423c-b76d-129b198d229d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:12.999434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 456/912] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:12 2022] GET /identity/v3/role_assignments?user.id=8499dabf82534db393da7811d003c4c7&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=ea49f084a93c4308be28d39e5a0ca80f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:13.327564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020313-9011-440a-98ad-17bb84dacde5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:13.328066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020313-9011-440a-98ad-17bb84dacde5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:13.328066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15020313-9011-440a-98ad-17bb84dacde5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:13.329584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 457/913] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:13.334953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581fb78-0f58-4cce-9b70-40eccd396f67 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:13.335338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581fb78-0f58-4cce-9b70-40eccd396f67 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:13.335518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581fb78-0f58-4cce-9b70-40eccd396f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:13.354575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a581fb78-0f58-4cce-9b70-40eccd396f67 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:13.355936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a581fb78-0f58-4cce-9b70-40eccd396f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:13.426903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 457/914] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:13.671767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34aaa-1e0b-4682-872a-1f898eff7544 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:13.671956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34aaa-1e0b-4682-872a-1f898eff7544 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:13.672225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df34aaa-1e0b-4682-872a-1f898eff7544 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:13.673840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 458/915] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:13.679096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:13.679385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:13.679660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:13.696357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df34aaa-1e0b-4682-872a-1f898eff7544 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:13.698985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:13.700331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:13.795714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 458/916] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:13.815833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df34aaa-1e0b-4682-872a-1f898eff7544 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:13.830664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:13.853460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:13.854437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:13.854919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:13.855387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:13.856186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:13.857794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:13.867251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:13.868245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 07:15:13.869120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:13.871840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 459/917] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:13.878491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:13.890307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:13.981515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbea177-3378-4620-bf04-6f636524de61 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.016947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.017605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.017885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.018201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.018852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:14.019153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.020507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.025567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 459/918] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:14.031837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.066892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.142901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:14.153403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac751f7-8664-4865-b83b-d7c9c860ff17 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.179834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c09300-571d-4418-b9d7-fc9a5dbaf702 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.198120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.198728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.199002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.199273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.199900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:14.200195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.202145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.207309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 460/919] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:14.215403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.222499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.223184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.223463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.223788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.224374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.225943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:14.236238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:14.237240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:14.238429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:14.242676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 460/920] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:14.243960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.265060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:14.335304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08225abd-ab07-4f62-a623-5b722899af8b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.376714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51387e-4066-49b1-8901-7cc4719881e2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.382715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.383532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.383956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.384375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.385220 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.386855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.415885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 461/921] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:14.431551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:14.438918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.439936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.440569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.441088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.441978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:14.442493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.444293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.456351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 461/922] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:14.458152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.567242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:14.577547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934a978-4857-4aba-9ce3-a0e526344c92 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.621277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.621890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.622393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.622672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.624859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:14.624859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.625490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a02fe-b75a-4b7b-93a9-f49e3ad76e2c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.634033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 462/923] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:14.636707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.646522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e82d4-211e-426f-8261-9167d0bec39d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.646818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e82d4-211e-426f-8261-9167d0bec39d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.647675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e82d4-211e-426f-8261-9167d0bec39d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.649198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 463/924] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:14.655709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.655998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.656269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.676138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:14.677359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:14.756025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 464/925] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:14.770772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf60b8-003e-4b76-9524-0432fff0bc32 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.805242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.805891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.806209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.806528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.807228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] RBAC: Adding query filter params (interface=public, service_id=2a3a57b11b7742f1b09cff1abf9c90d0, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:14.807531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.808894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d4a9b-f6be-4cad-9c35-6852e6b523ea None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.814958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 462/926] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/endpoints?service_id=2a3a57b11b7742f1b09cff1abf9c90d0&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:14.820384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:14.908421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c055aa-c50b-413e-9d63-b3dad0887445 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.908748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c055aa-c50b-413e-9d63-b3dad0887445 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.908976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c055aa-c50b-413e-9d63-b3dad0887445 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.910603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 463/927] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:14.915381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.915663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.915937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.918711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:14.931835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf8786-ec71-4db9-827f-e6462ebe2b37 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:14.934579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:14.936304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:14.974275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:14.975255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:14.975508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:14.975793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:14.976411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:14.977789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:14.991862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 465/928] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:14 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:15:15.021717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 464/929] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:15.022178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.038190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.151112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89c6b0-f277-4bdc-9c01-289d89d3d069 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.187573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.188213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.188477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.188740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.189320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.190706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:15.199835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:15.200804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:15.202364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 466/930] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:15.207078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.300555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.309202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10cf5a-18ee-4b96-b6a8-1c0e9a2cbb21 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.324462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.352573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.353193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.353449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.353719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.354410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:15.354697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.356069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.365988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 465/931] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:15.373464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.434563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.438949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d0878-0fa5-44a7-b5a4-f883781e74ab None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.487618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.488657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.489132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.489618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.491587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eca8-b383-40de-8206-5dc7236160fb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.500688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:15.506243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:15.507212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:15.508067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:15.510751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 467/932] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:15.519710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.536070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.536681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.536955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.537221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.537849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:15.538214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.539662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.550364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 466/933] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:15.551950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.618753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.644595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463526f-68c4-49f7-8fc0-7f2bc89bc7e3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.676150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a82131-134f-4056-8444-0257dcba8cf0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.687041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.687719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.688092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.688859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.689902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:15.690353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.692174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.696863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.706115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 468/934] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:15.709452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:15.727226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.728327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.728896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.729551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.730751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.732293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.757441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 467/935] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:15.823481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfde38-29a8-4195-828d-63c8d64b72b6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:15.867677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:15.868680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:15.869162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:15.869634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:15.881190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:15.886604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:15.888454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:15.905878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:15.906965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:15.907873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:15.907873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:15.907873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:15.910046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 469/936] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:15.915844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.021581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3690eb7-ea9f-4796-bdd3-8174a95a3081 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.056984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.057601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.057881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.058177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.058819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:16.059118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.061084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.073778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 468/937] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:16.079883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.193705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195d2b-a9ea-4849-a992-bb26f49f8291 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.228472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.229107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.229386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.229657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.237840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.239304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:16.251057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:16.252044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:16.253000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 470/938] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:16.258135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.293195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:16.360907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cad9d-25ec-4fc8-b2b1-dfef51fe735c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.403302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.403915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.404211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.404492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.405226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:16.405524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.406968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1e4c-7211-4db0-b708-1142f5967cc9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.425031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 469/939] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:16.430561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.475596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060a9c-0858-405e-a8d9-a248332ab049 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.476102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060a9c-0858-405e-a8d9-a248332ab049 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.476182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e060a9c-0858-405e-a8d9-a248332ab049 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.477566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 470/940] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:16.483212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:16.483626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.483626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.483929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.503067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:16.504359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:16.546357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd334f8-cbef-4abe-9088-c131be915914 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.576184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 471/941] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:16.589126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.589767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.590072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.590396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.602384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.603883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:16.619043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:16.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:16.620910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:16.620910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:16.620910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:16.620910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 471/942] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:16.627053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.662392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:16.730495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8779497-5cb7-4e3b-ba23-53f6cadddb81 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.766404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.767025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.767284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.767561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.768202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:16.768496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.769858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.781700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 472/943] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:16.787406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.853090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:16.904069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:16.908281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163c8f9-2e7f-4ef8-bd28-114ab754ecde None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.945722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:16.946783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:16.947301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:16.947797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:16.953383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:16.956665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:16.959399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:16.973388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:16.974375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:16.975294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:16.975787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69031ab3-c88e-47e8-bf9b-39a88f33933a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:16.978026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 472/944] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:16.987108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.015998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.016710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.016986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.017307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.017876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.019556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.022292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING keystone.server.flask.common [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 07:15:17.041810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.sql.core [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 07:15:17.041810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 07:15:17.041810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [parameters: {'id': '7c595ae9c354497ea4f681ce0e300c27', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 07:15:17.041810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eaf8665a-b0ae-49c0-ad2c-5c33a31408ac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c595ae9c354497ea4f681ce0e300c27.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c595ae9c354497ea4f681ce0e300c27. Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:15:17.049569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 07:15:17.050435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application yield resource Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise self.value Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application session.commit() Aug 17 07:15:17.056069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.flush() Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application compat.raise_( Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 07:15:17.057424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 07:15:17.058579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:15:17.059410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [parameters: {'id': '7c595ae9c354497ea4f681ce0e300c27', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.060617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:17.061553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c595ae9c354497ea4f681ce0e300c27. Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 473/945] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Aug 17 07:15:16 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad55c-4d5a-4ba3-adbe-6dcceda8a7ac None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.062682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad55c-4d5a-4ba3-adbe-6dcceda8a7ac None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.063500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad55c-4d5a-4ba3-adbe-6dcceda8a7ac None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.063500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 474/946] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:17.063500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad55c-4d5a-4ba3-adbe-6dcceda8a7ac None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.104779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff890e-74e9-483b-846f-bc3e789968d9 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.141881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.142596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.142990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.143347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.144094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:17.144464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.145983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7252f80-6371-4dd0-bf55-781903bbb7ef None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.159324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 473/947] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:17.160573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.160863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.161138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.167780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad55c-4d5a-4ba3-adbe-6dcceda8a7ac None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.179172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:17.180429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:17.195202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:17.215735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.216395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.216723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.217506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.226683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.228671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.230956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:17.243144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:17.244253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:17.245388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:17.248016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 475/948] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:17.249275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.262902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 474/949] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:17.266054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.381640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ed03-2aed-417e-ad09-36192eb9be4a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.386730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d30582-028f-4bce-8014-4b5f89b25c3a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.417953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.418507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.418785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.419054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.420279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:17.420593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.422156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.431042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.431896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.432351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.433283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/8499dabf82534db393da7811d003c4c7/roles/ea49f084a93c4308be28d39e5a0ca80f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.436340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=8499dabf82534db393da7811d003c4c7, role_id=ea49f084a93c4308be28d39e5a0ca80f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.438747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.440740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 475/950] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:17.457028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 476/951] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:17 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/8499dabf82534db393da7811d003c4c7/roles/ea49f084a93c4308be28d39e5a0ca80f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:15:17.573693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.590589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:17.688305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239c6da-a386-4c3a-9e96-f22a63ff80fc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.728395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.729037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.729315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.729583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.730258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.731627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-dbefc3fa-0416-4b7c-9e9a-ac7f62488bbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:17.741324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:17.742474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:17.743421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 476/952] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:17.749082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.812258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:17.813986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43d4f-260b-43b0-9ebc-cf2276ac6ec2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.814265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43d4f-260b-43b0-9ebc-cf2276ac6ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.814544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43d4f-260b-43b0-9ebc-cf2276ac6ec2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.816014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 477/953] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:17.821788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5739-3971-47fb-9029-777c35473420 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.822101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5739-3971-47fb-9029-777c35473420 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.822375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5739-3971-47fb-9029-777c35473420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.848130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a58e5739-3971-47fb-9029-777c35473420 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:17.849602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a58e5739-3971-47fb-9029-777c35473420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:17.867586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f5318-1fcf-415c-bcef-82af6a6a6978 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:17.914273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:17.915320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:17.915810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:17.916749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:17.917883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:17.918449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:17.921560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:17.933901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 477/954] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:17.935405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:17.938181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 478/955] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:18.041370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2e5c-54d1-47e5-91cc-d1500d9a2f3f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:18.064261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:18.077068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:18.077670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:18.077949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:18.078248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:18.078875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:18.079171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:18.080527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:18.085702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 478/956] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:18.091075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e5739-3971-47fb-9029-777c35473420 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:18.095333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:18.208025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e5739-3971-47fb-9029-777c35473420 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:18.215039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:18.258655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:18.259273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:18.261982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:18.261982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:18.261982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:18.261982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:18.297876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 479/957] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:18.358322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a92e5-1f88-4e1f-bd15-79655ffda84d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:18.417986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:18.417986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:18.417986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:18.417986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:18.418576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:18.418576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:18.424560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:18.425716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:18.431412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 479/958] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:18.433405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:18.518371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:18.552818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6d432-f89d-46d8-887b-48f694d09ccd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:18.595794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:18.596457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:18.597499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:18.597992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:18.598885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:18.599950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:18.601562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d602e5-8858-4a9c-a10d-a60f802c7cc4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:18.619286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 480/959] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:18.625381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:18.706475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:18.765061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d52af-ebe8-4860-96ec-00b036dcbf4b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:18.807721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:18.808251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:18.808528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:18.808801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:18.809434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:18.809731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:18.811821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba49fb1-7685-4101-bb95-e58b25161325 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:18.816773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 480/960] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:19.534131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1519-87da-4fb7-8867-0a67a97a84ca None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:19.534834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1519-87da-4fb7-8867-0a67a97a84ca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:19.535321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1519-87da-4fb7-8867-0a67a97a84ca None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:19.537115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 481/961] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:19.542656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:19.542945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:19.543218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:19.562980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:19.564566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:19.585823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812f1bb-fefd-4c3e-960e-0995434f932e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:19.586501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812f1bb-fefd-4c3e-960e-0995434f932e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:19.586982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812f1bb-fefd-4c3e-960e-0995434f932e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:19.588778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 482/962] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:19.594358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:19.594867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:19.595351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:19.614312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:19.616390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:19.641984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 481/963] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:19.688372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 483/964] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:19.911420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:19.958784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:19.975807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.022186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3153a8-3af4-417d-9fc1-b75ee81568ef None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.041978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.071688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.072841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.073269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.073708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.074761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.077662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.095921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732740d-89f3-4f06-b583-cec59cc29703 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.097813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.sql.core [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 07:15:20.097813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 07:15:20.097813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [parameters: {'user_id': '8b4387ea043e4e518bf976c345cab6a4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 07:15:20.097813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:15:20.107230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:15:20.108226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application yield resource Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise self.value Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application session.commit() Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 07:15:20.109252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.flush() Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application compat.raise_( Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 07:15:20.110221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 07:15:20.111166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 07:15:20.112081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [parameters: {'user_id': '8b4387ea043e4e518bf976c345cab6a4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:20.115465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 07:15:20.117055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.118233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 482/965] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Aug 17 07:15:19 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:20.125485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.145283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.146030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.146618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.146618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.158005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:20.163008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:20.163958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:20.164839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:20.169304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 484/966] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:20.170646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.245954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadcf76b-d748-4b1c-96a7-429706563bf6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.262442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.282479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.283420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.283887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.283994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97d6d-9fea-430e-ac54-12cba7700837 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.284450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.296693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.298585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.302611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:20.313749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:20.315057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 07:15:20.316272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:20.323441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 483/967] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:20.324887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.328789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.330457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.330840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.331216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.331989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:20.332392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.333869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.346519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 485/968] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:20.354756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.443865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c54970-eeac-4e71-b68e-ca4e2c282c8d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.478208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa3c3-3f89-45b4-8ad7-d1603ec0f05b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.479120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.479726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.480008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.480277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.480972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:20.481268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.483351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb826b25-2c4c-4c32-b3f2-8ac87dca44b9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.514152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.514783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.515061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.515357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.523931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 484/969] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:20.525078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53de4-2d26-43b2-a65d-3942e00a0187 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.525354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53de4-2d26-43b2-a65d-3942e00a0187 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.525623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f53de4-2d26-43b2-a65d-3942e00a0187 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.528831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.530770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.531463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 485/970] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:20.532860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c249-2e34-4af3-abf3-606ea3cb480c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.533143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c249-2e34-4af3-abf3-606ea3cb480c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.533412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883c249-2e34-4af3-abf3-606ea3cb480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:20.552239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:20.553300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:20.554268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:20.554268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:20.554268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:20.555440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 486/971] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:20.556368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6883c249-2e34-4af3-abf3-606ea3cb480c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:20.557939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6883c249-2e34-4af3-abf3-606ea3cb480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:20.571415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.584791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.614432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.647914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 486/972] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:20.695729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8684c5-dd2d-41c4-b6b5-971942acc2b1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.721010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afb004-f888-4286-9f24-41ee9c8709c8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.721334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afb004-f888-4286-9f24-41ee9c8709c8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.721560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afb004-f888-4286-9f24-41ee9c8709c8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.723146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 487/973] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:20.727877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.728178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.728426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.732938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.733741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.734189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.734607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.735401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:20.736047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.738775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.747908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:20.749080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:20.753514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 487/974] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:20.758527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.835870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 488/975] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:20.859357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:20.872306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fdd-8db2-49aa-a7db-99cf40ad9b82 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:20.906271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:20.906905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:20.907183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:20.907454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:20.914846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:20.916279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:20.925488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:20.928048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:20.929001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:20.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 488/976] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:20.934730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.012087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.033192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa507-7e95-4eb0-90eb-40a1bb5fd5b7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.042873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6d16d-5802-4a6f-8a93-d8787c1bf693 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.070218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.070845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.071123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.071399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.071966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.073313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.077916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.078482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.078761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.079031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.079755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:21.080056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.081461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:21.082932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:21.083919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:21.084859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 489/977] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:21.089947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.102923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 489/978] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Aug 17 07:15:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:21.103881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.112889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.189583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a840b-193b-4363-897c-c525478fe9c6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.201477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fa8dd-f2cb-4c84-be08-84404134d052 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.222575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.223165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.223444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.223713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.224330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:21.224624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.225994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.230734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 490/979] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:21.231334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.238175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.238784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.239063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.239335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.239980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.241344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.242275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.255618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 490/980] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:21 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:21.256405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.339123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.345390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e59c7-27a3-431a-986c-2f888ef99504 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.394349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349fae-2d50-4aae-9e82-eb9007e8d082 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.398847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.399975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.399975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.399975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.432392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.433007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.433287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.433557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.434227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:21.434528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.436427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.441325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 491/981] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:21.447353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.475716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.477160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.480247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.554856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87309e-95a1-4b73-84bc-0c3a86c51ca7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.577428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 491/982] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:21.582215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.583146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.593136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.593675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.594099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.594370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.595076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] RBAC: Adding query filter params (interface=admin, service_id=2a3a57b11b7742f1b09cff1abf9c90d0, region_id=RegionOne) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:21.595441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.596822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.606687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 492/983] 10.222.0.45 () {56 vars in 1249 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/endpoints?service_id=2a3a57b11b7742f1b09cff1abf9c90d0&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:21.607719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.684526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e88ea-a4fd-4f59-a12c-70e8e8910372 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.687422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:21.714796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f5e-0b26-46b8-beec-9948bbe98c6e None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.722001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.722505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.722781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.723050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.736606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.739188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.753983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:21.754362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:21.755297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:21.756208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:21.756208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:21.756208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:21.756383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.756383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.756383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.756383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.757105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.760514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 492/984] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:21.761165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.774215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 493/985] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:15:21.871434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68ded4-44d8-4b1a-9502-52e9273a7a60 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:21.909857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:21.910111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:21.911056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:21.911056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:21.911332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:21.911560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:21.912929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:21.926162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 493/986] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:21.931943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:21.990460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:22.036116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177edab-f21a-490b-9f47-c4676554782b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:22.069908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:22.070560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:22.070836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:22.071109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:22.077655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:22.079115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:22.090065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:22.091023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:22.092542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:22.094031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 494/987] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:22.097455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:22.117302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:22.205788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60983-8c19-4ac4-9460-4c73b74b0eca None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:22.241370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:22.241995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:22.242278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:22.242545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:22.243224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:22.243522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:22.244951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89d33-30fd-4c2d-9c93-018427607abe None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:22.256595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 494/988] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:22.262665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:22.367984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70788-6dcc-4aca-91ef-3f8200767689 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:22.381331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:22.401989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:22.402585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:22.402862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:22.403132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:22.403877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] RBAC: Adding query filter params (role.id=ea49f084a93c4308be28d39e5a0ca80f, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=8499dabf82534db393da7811d003c4c7) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:22.404697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:22.406156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42d3cf-8b88-4fb4-b5be-e583b62d7e95 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:22.417985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 495/989] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:22 2022] GET /identity/v3/role_assignments?user.id=8499dabf82534db393da7811d003c4c7&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=ea49f084a93c4308be28d39e5a0ca80f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:23.173785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131259d-ffe4-4033-a476-02a20b987af7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.174326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131259d-ffe4-4033-a476-02a20b987af7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.174438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131259d-ffe4-4033-a476-02a20b987af7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.175853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 495/990] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:23.180702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfa804-168f-4a5c-bfbc-0b888a264ec2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.181079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfa804-168f-4a5c-bfbc-0b888a264ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.181244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfa804-168f-4a5c-bfbc-0b888a264ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.199730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-febfa804-168f-4a5c-bfbc-0b888a264ec2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:23.201530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-febfa804-168f-4a5c-bfbc-0b888a264ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:23.269126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 496/991] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:23.538586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131259d-ffe4-4033-a476-02a20b987af7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:23.619323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:23.644379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131259d-ffe4-4033-a476-02a20b987af7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:23.678060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd8cd-32df-42b9-bda4-a694e8c80ee9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.678346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd8cd-32df-42b9-bda4-a694e8c80ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.678611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:23.678728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd8cd-32df-42b9-bda4-a694e8c80ee9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.679245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.679525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.679794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.680160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 497/992] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:23.681386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:23.684729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:23.685947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c450-74e1-423a-8920-4641df274195 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.686258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c450-74e1-423a-8920-4641df274195 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.686527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433c450-74e1-423a-8920-4641df274195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:23.693821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:23.698367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:23.699273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 496/993] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:23.700884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:23.704735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0433c450-74e1-423a-8920-4641df274195 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:23.706122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0433c450-74e1-423a-8920-4641df274195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:23.775544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 498/994] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:23.804965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea321c-9b77-406b-b4c6-a6aa5a18a235 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:23.838521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:23.839124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.839407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.839674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.840295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:23.840591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:23.841989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:23.846906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 497/995] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:23.852328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c450-74e1-423a-8920-4641df274195 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:23.892876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:23.954165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433c450-74e1-423a-8920-4641df274195 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:23.988361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:23.988969 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:23.989242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:23.989507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:23.990157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:23.990455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:23.991812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.001222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 499/996] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:24.003678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.007670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.042017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.112706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5280a-c307-4512-a6fd-12fd058e3db5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.148279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.148876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.149151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.149671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.150128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] RBAC: Adding query filter params (interface=public, service_id=c79f0d798b034f7ab0ce5388389f5603, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:24.150430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.151765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.156103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699552a7-c1af-49c1-8371-81fdb97901bd None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.157060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 498/997] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/endpoints?service_id=c79f0d798b034f7ab0ce5388389f5603&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:24.158075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.162467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.202396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.203086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.203310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.203576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.204153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.205550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:24.214554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:24.215578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.216733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 500/998] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:24.221420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.238856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.279252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6924f6c-099f-4732-939b-904af12ee09f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.315891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.316585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.317169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.317445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.318150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.319506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c60d-d564-4e9b-8b6d-c390a747247a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.325846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 499/999] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:15:24.327039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92089b-2583-4067-8301-763f554beafc None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.327321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92089b-2583-4067-8301-763f554beafc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.327690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92089b-2583-4067-8301-763f554beafc None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.329201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 500/1000] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:24.330558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940be391-2cde-4cd4-b5e9-3b8c73d72560 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.334711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.335008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.335262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.358228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:24.359467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:24.375857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.376399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.376679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.376950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.377602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:24.377900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.379379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.385117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 501/1001] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:24.390939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.427471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.449868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 501/1002] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:24.506469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19090-1b14-4ad5-82f4-d5cd03103fdb None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.539784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.540385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.540660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.540923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.541548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:24.541843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.543290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.548722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 502/1003] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:24.554609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.615426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.654828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff609c40-c7a5-4f24-b0f7-7ea44110690e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.688009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.688607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.688884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.689152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.689815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.691204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.713990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 502/1004] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:24.718272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.825458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:24.833981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5bc32-f4ab-4c82-97be-8336d7356235 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:24.877158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:24.877808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:24.878118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:24.878390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:24.878973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:24.880368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:24.889896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:24.891123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:24.892170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 503/1005] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:24.896943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:24.999887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809690d-344f-4866-95a9-0b05d97113cd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:25.022356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:25.036477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:25.037087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:25.037363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:25.037631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:25.038294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] RBAC: Adding query filter params (name=image) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:25.038591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:25.039947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaac9d-6c28-4c87-a6cb-143424195d9e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:25.044817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 503/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:25.050755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:25.153287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbb54e-7a46-4d0e-8e8b-307554e2e0de None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:25.189979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:25.190612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:25.190890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:25.191163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:25.191797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] RBAC: Adding query filter params (type=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:25.192095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:25.193491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c952ef-10a2-4c1c-8113-cce7b1c99e4e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:25.203926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 504/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:26.245668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fedd-674c-4a34-bcf1-5e9af51f7706 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.246262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fedd-674c-4a34-bcf1-5e9af51f7706 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.246262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044fedd-674c-4a34-bcf1-5e9af51f7706 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.248212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 504/1008] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:26.254353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543158-07d4-4b1d-b619-1a0e0a17c56b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.254865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543158-07d4-4b1d-b619-1a0e0a17c56b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.254942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2543158-07d4-4b1d-b619-1a0e0a17c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.273420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c2543158-07d4-4b1d-b619-1a0e0a17c56b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:26.274632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2543158-07d4-4b1d-b619-1a0e0a17c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:26.288366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:26.344641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 505/1009] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:26.612916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044fedd-674c-4a34-bcf1-5e9af51f7706 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:26.617106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d82f3-34bf-4812-af72-7b7531ed9557 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.617391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d82f3-34bf-4812-af72-7b7531ed9557 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.617664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d82f3-34bf-4812-af72-7b7531ed9557 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.619171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 506/1010] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:26.624420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.624699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.624968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.644624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:26.646117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:26.719116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044fedd-674c-4a34-bcf1-5e9af51f7706 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:26.722099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 507/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:26.753424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:26.754076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.754351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.754617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.755188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:26.756530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:26.765808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:26.767013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:26.767958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 505/1012] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:26.772835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:26.855502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:26.878438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7bbc-ec7b-474e-901a-cc249ec70d73 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:26.912125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:26.912735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:26.913014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:26.913280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:26.914027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:26.914331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:26.915751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:26.925212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 508/1013] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:26.926486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:26.978180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:26.993818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:27.030267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002278fa-efa6-4257-aeb2-97a7f995e250 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:27.065993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:27.066605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.066885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.067155 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.067782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:27.068085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:27.069452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a9153-da3b-4dca-be69-b517ed5d5070 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:27.079315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 506/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Aug 17 07:15:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:27.079315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a068-fdde-48e9-b876-d6f84b4675e4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.079315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a068-fdde-48e9-b876-d6f84b4675e4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.079315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a068-fdde-48e9-b876-d6f84b4675e4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.079315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 507/1015] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:27.080077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a068-fdde-48e9-b876-d6f84b4675e4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:27.102732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c79548-6313-4645-ab2a-4dd7c3b842e4 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:27.136031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:27.136574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.136846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.137111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.138222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:27.139641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753145c-8740-4211-8681-ae440015ac6e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:27.141182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 509/1016] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:27.142287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.142565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.142831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.159734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:27.160900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:27.164062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:27.180158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a068-fdde-48e9-b876-d6f84b4675e4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:27.194224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:27.215409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:27.215995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.216270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.216668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.217198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:27.218575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:27.227208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 510/1017] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:27.228009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:27.248447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 508/1018] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:27.347330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06614-5576-4a4e-8491-f3e4df844be0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:27.395158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:27.395998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.396437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.396848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.397629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:27.399109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576076a-664a-4760-8a36-f5f849a89534 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:27.405427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:27.428931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 511/1019] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:27 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:27.499834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:27.609293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57479a5-098e-450e-9bef-0e5fbb12db57 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:27.647420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:27.647945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:27.648219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:27.648484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:27.649119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:27.650552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b00efb-5a02-4c2a-ac7f-6e34c081e4d5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:27.668079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 509/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:27 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:29.281145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043f62-f0b0-42da-92f1-08f803c03833 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.281684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043f62-f0b0-42da-92f1-08f803c03833 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.281684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043f62-f0b0-42da-92f1-08f803c03833 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.283194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 512/1021] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:29.288138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009acc3a-db40-44c2-ab95-9f8208735de4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.288584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009acc3a-db40-44c2-ab95-9f8208735de4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.288668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009acc3a-db40-44c2-ab95-9f8208735de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.306545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-009acc3a-db40-44c2-ab95-9f8208735de4 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:29.307840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-009acc3a-db40-44c2-ab95-9f8208735de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:29.333048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:29.375915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5c66-9937-4c14-b74d-9933e50ce3a7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.376218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5c66-9937-4c14-b74d-9933e50ce3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.376457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5c66-9937-4c14-b74d-9933e50ce3a7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.377926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 513/1022] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:29.383587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c7f2-7e9f-4e51-b729-0e77d841f695 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.383954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c7f2-7e9f-4e51-b729-0e77d841f695 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.384140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21c7f2-7e9f-4e51-b729-0e77d841f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.392794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 510/1023] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:29.402436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cb21c7f2-7e9f-4e51-b729-0e77d841f695 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:29.403629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cb21c7f2-7e9f-4e51-b729-0e77d841f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:29.472879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 514/1024] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:29.557859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2607c-1a09-41df-9724-02fb65a63562 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.558161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2607c-1a09-41df-9724-02fb65a63562 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.558350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2607c-1a09-41df-9724-02fb65a63562 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.559815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 511/1025] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:29.565165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.565447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.565713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.584069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:29.585228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:29.651478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 515/1026] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:29.664031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2607c-1a09-41df-9724-02fb65a63562 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:29.740404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:29.768160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2607c-1a09-41df-9724-02fb65a63562 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:29.793263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:29.809544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:29.811003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.811283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.811551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.823778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:29.830743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:29.831726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:29.832614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:29.833954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 512/1027] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:29.838489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:29.856300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a54b7c-fa31-4c39-b9e9-8e0277fb4aa8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:29.856912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:29.894412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:29.895044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.895395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.895641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.896688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:29.898149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:29.899721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 516/1028] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:29.905363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:29.942266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aa6aa-fb03-48b0-902e-4ac3a36287d4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:29.976044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:29.976638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:29.976914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:29.977178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:29.977832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:29.978161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:29.979520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:29.988560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 513/1029] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:29.989334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.006033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c9e2c-f6bf-4204-a33a-b8f87fb9c07d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.022541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.040811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.041419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.041699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.041991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.042624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.044051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.065545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 517/1030] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:15:29 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:30.066584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.074553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.099150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ef9d-d8d0-4c55-9200-80586b44c2ec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.139795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.140473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.140754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.141028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] PATH_INFO: `/v3/services/image` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.141630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.143071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:30.153029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:30.154256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:30.155171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 514/1031] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 17 07:15:29 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:30.160359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.193138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3f6c0-03bd-4a80-868f-fd9a647e2989 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.236887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.238224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.238224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.238398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.251339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.252810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:30.270109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:30.271320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:30.272348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:30.272348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:30.272348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:30.274139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 518/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:30.277173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38fed-cced-451e-9cf0-2a5f1101d10a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.280219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.309050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.313330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.313951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.314251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.314584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.315225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:30.315662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.316973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.322345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 515/1033] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:30.327750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.337766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.398224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7216c-506b-4f55-bf95-1544720467fc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.436491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.437245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.437594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.437935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.438709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:30.439255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.440470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.442170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340847de-448c-4983-959d-6602d5716cf1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.453003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 519/1034] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:30.458334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.487181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.488039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.488310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.488578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.489195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:30.489490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.490871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.500763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 516/1035] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:30.502483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.550742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.578089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf577e-0525-44c7-ae20-ebee7fbc6bd5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.578317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.608655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.609281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.609547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.609811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.610161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bf579-160b-4881-84cd-d22aff589ca0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.617520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.618970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:30.630706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:30.631704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:30.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 520/1036] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:30.637496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.649321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.650046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.650330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.650613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.651299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] RBAC: Adding query filter params (interface=public, service_id=bd82849619ca4dbd8ef7cdc80fdcd01e, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:30.651606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.652962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.659075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 517/1037] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/endpoints?service_id=bd82849619ca4dbd8ef7cdc80fdcd01e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:30.664305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.743892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d55d-e267-4e69-9a8c-d512dcf39699 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.771740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fd4c0-00b1-40a0-bbe9-7395d7eebc90 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.781637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.782306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.782585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.783275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.784028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:30.784359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.785946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.803650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 521/1038] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:30.809226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:30.811777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.813569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.814266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.814561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.814831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:30.815427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:30.816898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:30.818553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:30.834089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 518/1039] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:15:30.921428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24a4f0-69eb-49e7-8570-a50c79d9b304 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:30.957668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:30.958312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:30.958590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:30.958860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.031901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.033363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.035886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:31.144195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 522/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 07:15:31.145391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:31.248162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001950-df83-4397-8030-b02ee85dfbff None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:31.283081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:31.283868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:31.284243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:31.284615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.296179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.297754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:31.312620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:31.314320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:31.315243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:31.315243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:31.315243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:31.318303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 519/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:31.319961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:31.432547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b851a-261f-428b-9979-b6f8804af553 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:31.434017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:31.469555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:31.470209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:31.470488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:31.470755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.471400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:31.471698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.473062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.490033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 523/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:31.491491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:31.543210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:31.595445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dee6e8-e6c7-4c82-8f80-f16b0f7b13c6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:31.631185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:31.631814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:31.632094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:31.632366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.639200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.640635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:31.652330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:31.653286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:31.659316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 520/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:31.659851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:31.762534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821f94c-afa6-4f6f-9b65-7611c98d8333 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:31.796621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:31.797259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:31.797542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:31.797832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.798535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:31.798839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.800307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4c89c-65f0-4fa9-be30-8d7e1496faf2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.817906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 524/1044] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:31.819145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:31.921201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35362519-9f1e-4974-9b6b-d02977c1fe33 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:31.932683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:31.958122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:31.958931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:31.959351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:31.959760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:31.960860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] RBAC: Adding query filter params (role.id=ea49f084a93c4308be28d39e5a0ca80f, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:31.961321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:31.962926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c34290-66d0-4ca3-a587-4b16a8305c0f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:31.974001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 521/1045] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:31 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=ea49f084a93c4308be28d39e5a0ca80f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:32.035968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fd63-6529-41df-b85b-f4eeb0cfd9ba None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.036175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fd63-6529-41df-b85b-f4eeb0cfd9ba None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.036457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fd63-6529-41df-b85b-f4eeb0cfd9ba None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.037808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 525/1046] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:32.043566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.043868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.044147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.063706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:32.064934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:32.138062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 522/1047] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:32.405124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fd63-6529-41df-b85b-f4eeb0cfd9ba None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:32.430951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:32.511832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fd63-6529-41df-b85b-f4eeb0cfd9ba None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:32.545844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:32.546487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.546760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.547022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.556764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:32.561852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:32.562811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:32.563700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 526/1048] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:32.569049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:32.669131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48977ca4-3c58-4d9b-9b19-6b52affdfd10 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:32.671380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:32.704026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:32.704616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.704887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.705152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.705806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:32.706128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:32.707473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad183-3662-4cc7-be5e-8831c0810dd9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:32.720009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 523/1049] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:32.721773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:32.745344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace57e8e-2cbe-463a-ad3c-9e67269d2c18 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.745631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace57e8e-2cbe-463a-ad3c-9e67269d2c18 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.745905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace57e8e-2cbe-463a-ad3c-9e67269d2c18 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.747891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 524/1050] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:32.752384 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.752668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.752930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.771625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:32.772809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:32.810834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:32.831708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c3e59-50b2-4a60-a92d-cb2e45aa4320 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:32.840223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 525/1051] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:32.866294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:32.866973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:32.867250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:32.867522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] PATH_INFO: `/v3/users/f488e3487dec4769a9630d2ca6578404` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:32.881933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] RBAC: Authorizing `identity:get_user(user_id=f488e3487dec4769a9630d2ca6578404)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:32.883450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:32.890375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 527/1052] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:32 2022] GET /identity/v3/users/f488e3487dec4769a9630d2ca6578404 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:32.891954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:32.987812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:32.995043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80657c91-05bf-489a-93b3-93e8bd7a3f51 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.029149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.029754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.030061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.030337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.104576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.106518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.109766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.204311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb553416-a5f6-44e9-b901-afc9a2315f42 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.216215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:33.223865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 526/1053] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 07:15:33.229660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.245258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.245811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.246111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.246373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] PATH_INFO: `/v3/services/image` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.246950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.248886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:33.257521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:33.258605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:33.260328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 528/1054] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Aug 17 07:15:33 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:33.264420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.269209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:33.336249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692e38-c37e-4679-ad60-ebba058890d3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.376436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.377071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.377470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.377746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.379038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.380405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.380876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7207c3-0118-4e44-a325-ff425331f025 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.382365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 527/1055] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:33 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:33.388271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.424040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.425268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.425698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.426151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.426930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] RBAC: Adding query filter params (name=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:33.427405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.429098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.434885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 529/1056] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:33.440131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.455443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:33.496992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d6fc-7aa3-409f-9e55-a9ed9b7ab893 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.514928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:33.537021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.538503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.538995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.539715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.540861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=acd0c8c6b4b044849de1abd1f149503a, user.id=f488e3487dec4769a9630d2ca6578404) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:33.541794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.543951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.550635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9769c13b-160f-4b95-adb2-b9a1e8bad860 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.551120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 528/1057] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:33 2022] GET /identity/v3/role_assignments?user.id=f488e3487dec4769a9630d2ca6578404&scope.project.id=acd0c8c6b4b044849de1abd1f149503a&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:33.599194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.599824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.600098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.600362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.601001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:33.601299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.602767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54ebe-2efc-4b66-8ec4-e308770b61e1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.609178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 530/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:33.615171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:33.720884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee4d7-8e44-45db-a7a9-85d580dd1779 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:33.748504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:33.757177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:33.757786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.758092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.758363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.759025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:33.760388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8f236-80f2-4820-b1f4-23e9bdf98773 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:33.786043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 529/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:15:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:33.882667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e2a9-2636-4e53-a331-35af89103b23 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.883019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e2a9-2636-4e53-a331-35af89103b23 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.883225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8e2a9-2636-4e53-a331-35af89103b23 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.884767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 531/1060] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:33.890755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:33.891047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:33.891302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:33.910252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:33.911457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:33.989319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 530/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:34.258519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8e2a9-2636-4e53-a331-35af89103b23 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:34.362094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8e2a9-2636-4e53-a331-35af89103b23 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:34.395942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:34.401609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:34.402263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:34.402538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:34.402804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:34.413225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:34.417826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:34.418908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:34.419864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 532/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:34.427249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:34.526843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bad3b-2189-40d8-8fe5-bd26a22e276f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:34.537389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:34.564284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:34.565108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:34.565558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:34.566018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:34.566826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:34.567272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:34.568884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:34.582016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 531/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:34.583585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:34.689298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d587a63-9d4a-4a54-86af-9cada17def1d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:34.723418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:34.724275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:34.724703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:34.725150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:34.735886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:34.737758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:34.752768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:34.753941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:34.755111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:34.755111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:34.755111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:34.756514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 533/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:34.762574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:34.867503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803f8e3-2761-42b8-a410-bcc1202c400a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:34.901121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:34.901721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:34.902021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:34.902289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:34.902914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:34.903207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:34.905175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:34.916947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 532/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:34.923045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:34.970694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.025576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0f297-bcef-4873-b1ea-91ea177c7721 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.059590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.060266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.060528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.060799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.068386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.069871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:35.080861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:35.081801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:35.082837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 534/1066] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:15:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:35.089631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.123488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.193198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b2fa-42e7-4a93-8608-e833594ced3a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.227750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.228357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.228626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.228904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.229602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:35.229899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.231330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b8961-90dc-4cf1-830c-b4133168b553 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.253556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 533/1067] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:35.255174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.362631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e9e9-0d30-4350-9d00-d96b11ba7f77 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.365261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.402693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.403229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.404172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.404444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.414992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.416421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:35.430087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:35.431083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:35.436805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:35.436805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:35.436805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:35.436805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 535/1068] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:35.437421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a014-9ff6-4763-a746-d8cec5e83d93 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.437700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a014-9ff6-4763-a746-d8cec5e83d93 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.437980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a014-9ff6-4763-a746-d8cec5e83d93 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.439048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.439546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 534/1069] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:35.444229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.444502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.444767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.462645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:35.463822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:35.538113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 535/1070] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:35.544579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7ee74-ab37-4ff0-8336-33a17476a4d1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.579479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.580078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.580357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.580622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.581252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:35.581546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.582928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c24a5-da76-4802-b0ac-147f3d0b15ad None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.599225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 536/1071] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:35.601292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.624600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.695325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b233a8-e994-4095-9941-65b5991530ba None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.695654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b233a8-e994-4095-9941-65b5991530ba None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.695891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b233a8-e994-4095-9941-65b5991530ba None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.697218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 537/1072] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:35.702743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.703030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.703301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.709022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3c2e3-668e-409b-9f17-b54ff12be7f1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.721170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:35.722392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:35.733268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.748557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.749395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.749672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.749935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.756975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.758465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:35.770100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:35.771532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:35.772754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 536/1073] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:35.777094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.801368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 538/1074] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:35.802325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.862223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:35.882365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235264d7-b621-4ec5-a7cf-e3308a7efe4a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.909156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a5b42-7e0c-47c5-a6c6-aa2d06e626e1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:35.914975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.915576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.915849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.916113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.916788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:35.917096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:35.918542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:35.930543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 537/1075] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:35.937033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.944678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:35.945308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:35.945639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:35.945847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:35.956429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:35.961021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:35.962149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:35.963221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 539/1076] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:35.968074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:35.976879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.047069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffddb6-afb2-4a36-8cf7-a52c29888c2a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.072697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfed7bd-c32f-4eff-aa3b-333e805da082 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.081123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.081777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.082091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.082366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/ea49f084a93c4308be28d39e5a0ca80f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.084511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=36a43ff4bca2482d871b6f8b7dec3a02, role_id=ea49f084a93c4308be28d39e5a0ca80f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.085926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.094253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.110000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 538/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:35 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/36a43ff4bca2482d871b6f8b7dec3a02/roles/ea49f084a93c4308be28d39e5a0ca80f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:15:36.110000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.114306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.115047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.115394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.115734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.116494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:36.116866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.118517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.128672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 540/1078] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:36.134790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.208413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.234043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f84c-a16d-4abc-8d81-48c760c358cc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.256281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad140-cfdf-442b-9656-bbb42288b18d None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.279430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.280386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.280904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.281243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.293587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.294781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.295056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.295324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] PATH_INFO: `/v3/users/f488e3487dec4769a9630d2ca6578404` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.296455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] RBAC: Authorizing `identity:get_user(user_id=f488e3487dec4769a9630d2ca6578404)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.297910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.299516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 541/1079] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:36 2022] GET /identity/v3/users/f488e3487dec4769a9630d2ca6578404 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:36.305516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.360771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.364265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.368082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.422516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f6365-cdaa-425d-8eae-e53e6acc5724 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.459020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.459954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.460429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.460887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.462044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.463487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.465123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 542/1080] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:36 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:36.471434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.474142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 539/1081] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:36.477380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.478329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.579224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.583100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9eb5-903f-49fc-aa93-882245f139df None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.585469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbfe55-69e5-4248-be40-ec3d1539e443 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.620220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.621083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.621505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.621952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.622092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.622748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.623022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.623290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a/users/f488e3487dec4769a9630d2ca6578404/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.625150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] RBAC: Authorizing `identity:create_grant(project_id=acd0c8c6b4b044849de1abd1f149503a, user_id=f488e3487dec4769a9630d2ca6578404, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.626617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.634610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.636075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.641018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 543/1082] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:36 2022] PUT /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a/users/f488e3487dec4769a9630d2ca6578404/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-bca46cb3-e872-47a9-ac8d-2e3e9c54d571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:36.661219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:36.662557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:36.663529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:36.663529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:36.663529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:36.664147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 540/1083] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:36.669173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:36.741736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:36.789504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d10542-d2ea-45ee-b7dd-7dc7ffa6d420 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:36.824202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:36.824810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:36.825085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:36.825876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:36.826551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:36.826849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:36.828211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8a300-20a6-4569-b1e7-ab211bba5866 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:36.839947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 544/1084] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:38.003126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dbe08-24db-4966-8f12-23a4ad4c4a38 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.003650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dbe08-24db-4966-8f12-23a4ad4c4a38 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.003650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dbe08-24db-4966-8f12-23a4ad4c4a38 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.004990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 541/1085] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:38.010276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.010694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.010824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.028321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:38.030226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:38.095609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 545/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:38.360777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dbe08-24db-4966-8f12-23a4ad4c4a38 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.459436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dbe08-24db-4966-8f12-23a4ad4c4a38 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:38.492948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:38.493566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.493841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.494140 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.504426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-bb6ec66e-41df-4e14-8f0f-0210c48fff65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:38.509032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:38.510076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:38.510977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 542/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:38.516712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.532831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c7ee1-3bf7-4eca-aacd-b77f86aed8d6 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.533119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c7ee1-3bf7-4eca-aacd-b77f86aed8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.533396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c7ee1-3bf7-4eca-aacd-b77f86aed8d6 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.534920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 543/1088] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:15:38.539435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.539717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.539995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.557164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:38.558386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:38.566087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:38.572503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:38.616255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6f67-4238-4124-ac1c-91adb8d0f5f6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:38.625426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 544/1089] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:38.649735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:38.650369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.650646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.650916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.651578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:38.651877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:38.653238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:38.665432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 546/1090] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:38.666568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.763464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a17be-70fe-4646-a3f8-a311c1ef1214 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:38.795214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:38.795827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.796100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.796366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.805867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:38.807313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:38.808987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:38.824116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:38.825082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:38.826605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:38.826605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:38.826605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:38.826605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 545/1091] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:38.831658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.898404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.929171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5139d-2069-4027-8360-f51eb6c7b6cc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:38.945176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:38.963902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:38.964511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:38.964789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:38.965058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:38.965700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:38.966089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:38.967634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:38.979159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 547/1092] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:38.985141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:38.996338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637879-7427-4a0e-b49a-82a22c30decf None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.029163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.029786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.030077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.030349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.040635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:39.045847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:39.046901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:39.047775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 546/1093] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:39.052889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.085253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1aca1f-b4a6-414f-bc3d-6a600b89a5dc None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.105728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.119123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.119741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.120021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.120393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.129082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.130568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:15:39.141344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:39.142334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:39.143317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 548/1094] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Aug 17 07:15:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:39.148052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.150450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59b570-4ee9-4cb7-837d-afcdbbcc7689 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.181463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.183206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.183831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.184115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.184381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.185629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:39.185923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.187301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.195776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 547/1095] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:39.201519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.245279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953d27c-36f0-4f82-ad4e-e3ef821d0174 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.278121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.278738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.279009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.279274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.279986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:39.280281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.281697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.298430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 549/1096] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:39.298566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eac20-fd56-47aa-ba29-0c3fa63384ef None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.304098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.318979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.337489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.338143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.338423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.338695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] PATH_INFO: `/v3/users/f488e3487dec4769a9630d2ca6578404` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.339819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] RBAC: Authorizing `identity:get_user(user_id=f488e3487dec4769a9630d2ca6578404)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.341801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.343413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 548/1097] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/users/f488e3487dec4769a9630d2ca6578404 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:39.349220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.402850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.410788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bcbab-4229-46cf-8dbf-ea6d20869415 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.444350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.444949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.445227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.445423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccfcf4-efcd-4970-b271-f314fbada7bf None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.445524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.480199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.480793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.481069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.481337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.521190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.522686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.533005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.549593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.551061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.613991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.621448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 550/1098] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:39.627574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.649402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 549/1099] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 07:15:39.655636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.723471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e23ae8-bd69-4ba5-a47d-db3de7487231 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.735997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.752238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f092e73-675f-4af4-9b31-5fa4fdb19bde None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.757239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.757860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.758159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.758427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.769325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.770782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:15:39.786158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:39.787325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:15:39.788258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:15:39.788258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:15:39.788258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:39.788444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.788444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.788444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.788444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.788717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 551/1100] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:15:39.789552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.790989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.792711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 550/1101] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:39.792907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.798462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.839250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:39.892743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5556f-e07d-4d0f-9c96-c5e6bd56b5c5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.895706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55b492-4557-49f2-8e15-ddc00ad68b1c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:39.925338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.925870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.926172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.926440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.927075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:39.927370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.928213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:39.928729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.928837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:39.929059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:39.929325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:39.930057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=acd0c8c6b4b044849de1abd1f149503a, user.id=f488e3487dec4769a9630d2ca6578404) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:39.930362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:39.931754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:39.937905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 551/1102] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/role_assignments?user.id=f488e3487dec4769a9630d2ca6578404&scope.project.id=acd0c8c6b4b044849de1abd1f149503a&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:39.944921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 552/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:39.946166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:39.966913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:40.051018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f5c3-7a3e-49df-94b1-40b27790e361 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:40.087798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:40.088419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:40.088693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:40.088960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:40.095628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:40.097056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:15:40.108081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:40.109006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:15:40.110099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 552/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:40.115616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:40.213822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f57f-0763-4a78-bee4-ccd8ef37c1b6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:40.221229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:40.248595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:40.249207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:40.249477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:40.249741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:40.250453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:40.250754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:40.252184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5a284-a373-43cd-bc57-7ac7c0277bcd None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:40.270299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 553/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:40.276262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:40.351827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:40.377986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2c0d-c716-4187-a69f-b45d6c809448 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:40.411363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:40.411965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:40.412241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:40.412509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:40.413230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] RBAC: Adding query filter params (role.id=ea49f084a93c4308be28d39e5a0ca80f, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=36a43ff4bca2482d871b6f8b7dec3a02) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:40.413534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:40.414985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221309d-689e-433a-8426-8eaf38772270 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:40.420940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 553/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:40 2022] GET /identity/v3/role_assignments?user.id=36a43ff4bca2482d871b6f8b7dec3a02&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=ea49f084a93c4308be28d39e5a0ca80f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:41.845544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953570fb-4fef-413a-8eb0-ff91b5e4ea89 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:41.846100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953570fb-4fef-413a-8eb0-ff91b5e4ea89 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:41.846100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953570fb-4fef-413a-8eb0-ff91b5e4ea89 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:41.847449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 554/1107] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:41.852429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:41.852854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:41.852949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:41.871197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:41.872355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:41.935457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 554/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:42.202446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953570fb-4fef-413a-8eb0-ff91b5e4ea89 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:42.300977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953570fb-4fef-413a-8eb0-ff91b5e4ea89 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:42.333729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:42.334384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:42.334660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:42.334927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:42.336020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:42.337442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795c14-8e71-431e-94c8-0297c2b9e175 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:42.339021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 555/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:42.344927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:42.411541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:42.441164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151f50-509e-48da-b9b7-1360d6b0ea07 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:42.473569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:42.474136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:42.474414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:42.474684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:42.475306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:42.476712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75246c-14a6-465b-9af6-d233ac3e4daf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:42.495918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 555/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:15:42 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:44.381914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b390cb-a406-48e1-b875-44fdfa18ccc4 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:44.382426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b390cb-a406-48e1-b875-44fdfa18ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:44.382519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b390cb-a406-48e1-b875-44fdfa18ccc4 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:44.383816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 556/1111] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:44.388915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:44.389318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:44.389453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:44.406994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:44.408153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:44.471110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 556/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:44.740010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b390cb-a406-48e1-b875-44fdfa18ccc4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:44.773882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:44.838793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b390cb-a406-48e1-b875-44fdfa18ccc4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:44.872090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:44.872701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:44.872976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:44.873242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] PATH_INFO: `/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:44.874654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] RBAC: Authorizing `identity:get_role(role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:44.875997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:44.877282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 557/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:44 2022] GET /identity/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:44.882922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:44.936466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:44.980083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f9f8-c326-4050-a363-e68b0ba4b82f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:45.012131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:45.013221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:45.013495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:45.013762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] PATH_INFO: `/v3/users/08171d65fb0d49419ebbb84eadff303c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:45.026203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] RBAC: Authorizing `identity:get_user(user_id=08171d65fb0d49419ebbb84eadff303c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:45.027618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:45.029722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 557/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:44 2022] GET /identity/v3/users/08171d65fb0d49419ebbb84eadff303c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:45.035537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:45.129409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa89f6-3fef-431f-b494-05d4b47fba91 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:45.130909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:45.163162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:45.163743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:45.164018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:45.164283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:45.228099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:45.229516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:45.321804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 558/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:45.328144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:45.423880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dd98f-c6e1-47ea-8e90-55b711a0dd81 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:45.437678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:45.458101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:45.458725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:45.459000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:45.459267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:45.460342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:45.461748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b8ea-d792-49a8-8e1c-5580f2e8518b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:45.463383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 558/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:45 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:45.469467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:45.471620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:45.566460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d77a09-a1d0-449a-89a2-74f5849b25a0 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:45.599299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:45.599831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:45.600107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:45.600375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:45.601087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=acd0c8c6b4b044849de1abd1f149503a, user.id=08171d65fb0d49419ebbb84eadff303c) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:45.601391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:45.602827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7429fa-de36-4691-9fc5-afd34393d0f2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:45.608054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 559/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:45 2022] GET /identity/v3/role_assignments?user.id=08171d65fb0d49419ebbb84eadff303c&scope.project.id=acd0c8c6b4b044849de1abd1f149503a&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:47.431220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94a00-df07-4f8c-8a75-0e198fc4a528 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:47.431722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94a00-df07-4f8c-8a75-0e198fc4a528 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:47.431815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94a00-df07-4f8c-8a75-0e198fc4a528 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:47.433099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 559/1118] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:47.438259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:47.438692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:47.438787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:47.456623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:47.457778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:47.514496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:47.521973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 560/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:47.787270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94a00-df07-4f8c-8a75-0e198fc4a528 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:47.885332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94a00-df07-4f8c-8a75-0e198fc4a528 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:47.917566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:47.918198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:47.918475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:47.918767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] PATH_INFO: `/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:47.920124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] RBAC: Authorizing `identity:get_role(role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:47.921467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:47.922782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 560/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:47 2022] GET /identity/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:47.928562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:48.025109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1aa2d-809d-426d-a418-9b486aa273a7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:48.057885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627c2f-088a-422b-9248-329192650614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:48.058475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627c2f-088a-422b-9248-329192650614 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:48.058754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627c2f-088a-422b-9248-329192650614 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:48.059029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627c2f-088a-422b-9248-329192650614 None admin] PATH_INFO: `/v3/users/08171d65fb0d49419ebbb84eadff303c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:48.060712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627c2f-088a-422b-9248-329192650614 None admin] RBAC: Authorizing `identity:get_user(user_id=08171d65fb0d49419ebbb84eadff303c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:48.062163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627c2f-088a-422b-9248-329192650614 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:48.063702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 561/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:47 2022] GET /identity/v3/users/08171d65fb0d49419ebbb84eadff303c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:48.069126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:48.117101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:48.164574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8211f7-8919-44df-8d26-7919f44997bc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:48.197343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:48.197949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:48.198251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:48.198522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:48.199608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:48.201037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e229d-4f5e-4cc3-bea7-0c9443075108 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:48.202655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 561/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:48 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:48.208312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627c2f-088a-422b-9248-329192650614 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:48.269037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:48.306113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627c2f-088a-422b-9248-329192650614 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:48.338373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:48.338960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:48.339237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:48.339508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a/users/08171d65fb0d49419ebbb84eadff303c/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:48.342159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] RBAC: Authorizing `identity:create_grant(project_id=acd0c8c6b4b044849de1abd1f149503a, user_id=08171d65fb0d49419ebbb84eadff303c, role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:48.343592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb16858-4555-43f7-a5da-15572e3a79af None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:48.357395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 562/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:15:48 2022] PUT /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a/users/08171d65fb0d49419ebbb84eadff303c/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:15:50.195979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179328-2fc9-419a-89de-c10feb4f84c2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:50.196560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179328-2fc9-419a-89de-c10feb4f84c2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:50.196560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179328-2fc9-419a-89de-c10feb4f84c2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:50.197844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 562/1124] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:50.203498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:50.203942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:50.204043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:50.222148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:50.223319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:50.288407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 563/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:15:50.561001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179328-2fc9-419a-89de-c10feb4f84c2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:50.657936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab179328-2fc9-419a-89de-c10feb4f84c2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:50.674747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:50.690820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:50.691429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:50.691705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:50.691976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] PATH_INFO: `/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:50.693339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] RBAC: Authorizing `identity:get_role(role_id=d4c8cef2a7704bb3a0313d5956b67fa3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:50.694720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:50.696012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 563/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:50 2022] GET /identity/v3/roles/d4c8cef2a7704bb3a0313d5956b67fa3 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:50.701707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:50.754625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:50.798378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e01d-e8ab-4a9e-a246-b111bc97f43d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:50.830004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:50.830563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:50.830833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:50.831097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] PATH_INFO: `/v3/users/08171d65fb0d49419ebbb84eadff303c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:50.832181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] RBAC: Authorizing `identity:get_user(user_id=08171d65fb0d49419ebbb84eadff303c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:50.833597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:50.835159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 564/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:50 2022] GET /identity/v3/users/08171d65fb0d49419ebbb84eadff303c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:50.841350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:50.936445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b54907-2de8-4e8b-b49a-fa63207ef244 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:50.969095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:50.969672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:50.969945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:50.970239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:51.020774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:51.034265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:51.035674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:51.127494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 564/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:51.133497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:51.228356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2558f-3efe-4bfb-bd11-2a510e2b2a10 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:51.249422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:51.260681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:51.261284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:51.261557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:51.261822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] PATH_INFO: `/v3/projects/acd0c8c6b4b044849de1abd1f149503a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:51.263456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] RBAC: Authorizing `identity:get_project(project_id=acd0c8c6b4b044849de1abd1f149503a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:51.264893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf94fe5-c930-453b-9336-9df46a3a74cb None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:51.266504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 565/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:51 2022] GET /identity/v3/projects/acd0c8c6b4b044849de1abd1f149503a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:51.272519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:51.352981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:51.367711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf511d2-cecd-4a41-8f01-171c3d1077b3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:51.401290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:51.401818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:51.402122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:51.402391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:51.403116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] RBAC: Adding query filter params (role.id=d4c8cef2a7704bb3a0313d5956b67fa3, scope.project.id=acd0c8c6b4b044849de1abd1f149503a, user.id=08171d65fb0d49419ebbb84eadff303c) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:51.403413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:51.404815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287628bb-c6c4-435d-a7d4-ede0b95b5cff None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:51.410327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 565/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:51 2022] GET /identity/v3/role_assignments?user.id=08171d65fb0d49419ebbb84eadff303c&scope.project.id=acd0c8c6b4b044849de1abd1f149503a&role.id=d4c8cef2a7704bb3a0313d5956b67fa3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:53.287844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e4ed-fd79-4ab9-8e4a-44b7f31eb7f5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:53.288392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e4ed-fd79-4ab9-8e4a-44b7f31eb7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:53.288392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768e4ed-fd79-4ab9-8e4a-44b7f31eb7f5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:53.289690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 566/1131] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:53.294742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:53.295618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:53.295822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:53.313661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:53.314862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:53.380815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 566/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:53.646661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768e4ed-fd79-4ab9-8e4a-44b7f31eb7f5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:53.745372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768e4ed-fd79-4ab9-8e4a-44b7f31eb7f5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:53.777640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:53.778279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:53.778558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:53.778828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:53.780413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:53.781856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc81362-4cac-4245-bb2a-58600c760a70 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:53.783403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 567/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:53.789020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:53.866689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:53.885167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dcc24-d19c-49f9-8c74-804b18ab7f1d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:53.917601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:53.918177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:53.918456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:53.918727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:53.919363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:53.921330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24172223-a42a-42f2-af4d-febb9fc60770 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:53.946902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 567/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:15:53 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:15:55.831620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ada1-1cca-4fc3-a49b-c03efde67942 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:55.832152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ada1-1cca-4fc3-a49b-c03efde67942 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:55.832152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ada1-1cca-4fc3-a49b-c03efde67942 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:55.833473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 568/1135] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:55.838622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:55.839025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:55.839166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:55.856703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:55.857878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:55.921740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 568/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:56.188652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ada1-1cca-4fc3-a49b-c03efde67942 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:56.245276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:56.285412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ada1-1cca-4fc3-a49b-c03efde67942 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:56.319284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:56.319900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:56.320172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:56.320438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:56.321524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:56.322972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf2728-3cc8-4027-92e3-73b7db7fa272 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:56.324515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 569/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:56.330234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:56.389749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:56.431371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7a070-1b95-4b62-b99d-6ed898a7941b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:56.463802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:56.464344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:56.464620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:56.464889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:56.465525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:56.466966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf38e3-3fb7-4b0c-8e9a-e85f6c20707d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:56.487915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 569/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:15:56 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:15:58.400577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721394b-e090-4df4-a505-b1a20d7334ae None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:58.401083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721394b-e090-4df4-a505-b1a20d7334ae None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:58.401178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721394b-e090-4df4-a505-b1a20d7334ae None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:58.402471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 570/1139] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:15:58.408025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:58.408438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:58.408568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:58.426656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:15:58.427829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:15:58.491517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 570/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:15:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:15:58.758452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721394b-e090-4df4-a505-b1a20d7334ae None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:58.856388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721394b-e090-4df4-a505-b1a20d7334ae None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:58.881295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:58.890442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:58.891055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:58.891331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:58.891599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:58.901325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:15:58.906099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:15:58.907265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:15:58.908384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 571/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:15:58.913214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:58.959763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:59.009630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931c52c-5e4d-49c9-afe0-b490035e2ec5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:59.042531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:59.043118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:59.043393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:59.043657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:59.044305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:59.044600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:59.046164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:59.053775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 571/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:15:59.059772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:59.157807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c044-ac83-456f-8f1a-f4319fce07d1 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:59.190876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:59.191509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:59.191789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:59.192062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] PATH_INFO: `/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:59.204545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2a7a2a6e2a4ebba07d7ec52a6759f5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:59.205997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:59.207552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 572/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:15:59 2022] GET /identity/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:59.213269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:59.308759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb6479-d923-421a-9ab0-e6603ff68073 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:59.318970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:59.341671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:59.342309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:59.342588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:59.342857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:59.407990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:59.409424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:59.503414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 572/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:15:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:15:59.509567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:59.553976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:59.605580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fcd48-9a32-4f4e-90ac-2f83eabaacb3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:59.638224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:59.638865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:59.639141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:59.639412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] PATH_INFO: `/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:59.640501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] RBAC: Authorizing `identity:get_project(project_id=6e6fbf5bdce74c0cbbb1538274f8a4a6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:59.641933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd443ed-707d-4ef4-876a-21e278ab0546 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:59.643543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 573/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:15:59 2022] GET /identity/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:15:59.649473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:15:59.661101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:15:59.745165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6dda-ad51-4745-8287-e3021134a881 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:15:59.776904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:15:59.777491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:15:59.777767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:15:59.778064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:15:59.778781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=6e6fbf5bdce74c0cbbb1538274f8a4a6, user.id=4b2a7a2a6e2a4ebba07d7ec52a6759f5) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:15:59.779085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:15:59.781008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b138d7-8ccd-4002-87ca-0fb7b2346c29 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:15:59.786191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 573/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:15:59 2022] GET /identity/v3/role_assignments?user.id=4b2a7a2a6e2a4ebba07d7ec52a6759f5&scope.project.id=6e6fbf5bdce74c0cbbb1538274f8a4a6&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:01.616302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6a4c-c874-4cec-8c19-6820ad9ef303 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:01.616811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6a4c-c874-4cec-8c19-6820ad9ef303 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:01.616811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6a4c-c874-4cec-8c19-6820ad9ef303 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:01.618123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 574/1147] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:01.623145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:01.623526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:01.623676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:01.641579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:01.642763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:01.710481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 574/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:01.972956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6a4c-c874-4cec-8c19-6820ad9ef303 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:02.070725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6a4c-c874-4cec-8c19-6820ad9ef303 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:02.083749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:02.104216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:02.104827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:02.105101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:02.105366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:02.115312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:16:02.119939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:02.121041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:16:02.122119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 575/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:02.127380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:02.130413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:02.222662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d79a17-4d65-4c0b-a434-3d386bedb6ce None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:02.255809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:02.256338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:02.256615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:02.256884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:02.257536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:02.257840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:02.259231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:02.266952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 575/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:02.272497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:02.369290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098b088-846a-4326-9754-fb98ac98263a None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:02.402194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:02.402808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:02.403083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:02.403353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] PATH_INFO: `/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:02.404474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2a7a2a6e2a4ebba07d7ec52a6759f5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:02.405899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:02.407480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 576/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:16:02 2022] GET /identity/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:02.413198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:02.476537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:02.511008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ca1a9-10e8-4bdb-9a84-40a966348f5d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:02.542710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:02.543318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:02.543595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:02.543863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] PATH_INFO: `/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:02.545545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] RBAC: Authorizing `identity:get_project(project_id=6e6fbf5bdce74c0cbbb1538274f8a4a6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:02.546993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df14e7f-dd6f-4854-b116-2288f2ee90ee None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:02.548579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 576/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:16:02 2022] GET /identity/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:02.554395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:02.594924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:02.651274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ae21-7c8b-4997-9e10-42d188b4f6b3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:02.683664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:02.684301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:02.684576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:02.684840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] PATH_INFO: `/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:02.686749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] RBAC: Authorizing `identity:create_grant(project_id=6e6fbf5bdce74c0cbbb1538274f8a4a6, user_id=4b2a7a2a6e2a4ebba07d7ec52a6759f5, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:02.688163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3a6f-1124-48c8-b518-6e1359c2c32f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:02.700723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 577/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:16:02 2022] PUT /identity/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:16:04.564223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447dfe-86ab-4765-8ca2-b6f7fc9b21e8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:04.564733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447dfe-86ab-4765-8ca2-b6f7fc9b21e8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:04.564733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf447dfe-86ab-4765-8ca2-b6f7fc9b21e8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:04.566151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 577/1154] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:04.571389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:04.571792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:04.571924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:04.589921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:04.591119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:04.655148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 578/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:04.919722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447dfe-86ab-4765-8ca2-b6f7fc9b21e8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.019137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf447dfe-86ab-4765-8ca2-b6f7fc9b21e8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.050809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.051415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.051688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.051952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.053706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:05.063382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:16:05.068002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:05.069061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:16:05.069935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 578/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:05.075117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.103688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:05.171149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c04696-5d6c-4716-b481-e9cff26a64c1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.203285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.203871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.204143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.204407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.205055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:05.205346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:05.206721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:05.214326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 579/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:05.219949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.315782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a3bb7-47eb-43d1-b82b-89a136f85587 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.347090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.347710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.347987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.348254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] PATH_INFO: `/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.349367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] RBAC: Authorizing `identity:get_user(user_id=4b2a7a2a6e2a4ebba07d7ec52a6759f5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:05.350811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:05.352374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 579/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:16:05 2022] GET /identity/v3/users/4b2a7a2a6e2a4ebba07d7ec52a6759f5 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:05.358736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.446936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:05.455754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb753-0e7f-4d86-8fe5-f2bebd214328 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.488461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.489054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.489332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.489600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.554340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:05.555777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:05.639809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:05.649163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 580/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:16:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 07:16:05.655627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.713906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:05.751990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd84de6-8eae-41ba-8f24-46416f1eee30 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.783821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.784428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.784705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.784996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] PATH_INFO: `/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.786119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] RBAC: Authorizing `identity:get_project(project_id=6e6fbf5bdce74c0cbbb1538274f8a4a6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:05.787534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488770c-5d86-49b3-85ce-050df888141f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:05.789123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 580/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:16:05 2022] GET /identity/v3/projects/6e6fbf5bdce74c0cbbb1538274f8a4a6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:05.795692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:05.890272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae2ea4-8e96-491a-837e-51501c9a4250 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:05.923342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:05.923930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:05.924206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:05.924474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:05.925186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=6e6fbf5bdce74c0cbbb1538274f8a4a6, user.id=4b2a7a2a6e2a4ebba07d7ec52a6759f5) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:05.925490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:05.926929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356d94-b747-426b-8ec0-dd0cf9517353 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:05.932470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 581/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:16:05 2022] GET /identity/v3/role_assignments?user.id=4b2a7a2a6e2a4ebba07d7ec52a6759f5&scope.project.id=6e6fbf5bdce74c0cbbb1538274f8a4a6&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:16:07.800517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e2c6c-6a55-4bc3-8c8b-18ad32dc6630 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:07.801064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e2c6c-6a55-4bc3-8c8b-18ad32dc6630 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:07.801064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e2c6c-6a55-4bc3-8c8b-18ad32dc6630 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:07.802485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 581/1162] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:07.807720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:07.808130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:07.808262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:07.826295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:07.827472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:07.875920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:07.891751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 582/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:08.158293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e2c6c-6a55-4bc3-8c8b-18ad32dc6630 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:08.255811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e2c6c-6a55-4bc3-8c8b-18ad32dc6630 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:08.283064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:08.289023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:08.289610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:08.289887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:08.290185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:08.354240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:08.355689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:08.450279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 582/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:16:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:16:08.456716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:08.550831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb69d2-bc6f-4e66-ba04-564d518f919a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:08.583403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:08.584007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:08.584278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:08.584544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:08.590973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:08.592425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c81abcac-f0ed-4bbd-b900-70e982d29d9d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:08.603358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:08.604556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:16:08.605623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 583/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:16:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:08.610508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:08.639776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:08.705955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e86434-49ee-4d1d-aa16-d5738f7917a8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:08.737627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:08.738244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:08.738518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:08.738783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:08.739408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:08.739701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:08.741038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8643719-3f64-42d6-b6e7-b62ff398c1dc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:08.748306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 583/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Aug 17 07:16:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:10.605857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90f51-1e21-4ba0-b5e0-0a3e92786ebb None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:10.606379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90f51-1e21-4ba0-b5e0-0a3e92786ebb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:10.606379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac90f51-1e21-4ba0-b5e0-0a3e92786ebb None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:10.607706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 584/1167] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:10.612990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91db20-ca9e-4b30-b281-ffe4df6fe7b6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:10.613461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91db20-ca9e-4b30-b281-ffe4df6fe7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:10.613897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91db20-ca9e-4b30-b281-ffe4df6fe7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:10.631416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7b91db20-ca9e-4b30-b281-ffe4df6fe7b6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:10.632597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7b91db20-ca9e-4b30-b281-ffe4df6fe7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:10.696228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 584/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:10.963495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac90f51-1e21-4ba0-b5e0-0a3e92786ebb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:11.009876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:11.062818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac90f51-1e21-4ba0-b5e0-0a3e92786ebb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:11.095931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:11.096526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:11.096800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:11.097064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:11.097722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:11.099102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ffd34-b423-47d0-b7d7-f0156d6b8042 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:11.114590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 585/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Wed Aug 17 07:16:10 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:16:13.000035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bf5e-4af4-4108-bd5d-70036275e5ea None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:13.000557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bf5e-4af4-4108-bd5d-70036275e5ea None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:13.000678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bf5e-4af4-4108-bd5d-70036275e5ea None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:13.001953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 585/1170] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:13.007244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:13.007618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:13.007788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:13.025730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:13.026946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:13.092128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 586/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:13.363387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559bf5e-4af4-4108-bd5d-70036275e5ea None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:13.388173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:13.461242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559bf5e-4af4-4108-bd5d-70036275e5ea None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:13.493627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:13.494269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:13.494548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:13.494819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] PATH_INFO: `/v3/domains/de7e097221854b3999eedc9c66a82f52` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:13.505222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=de7e097221854b3999eedc9c66a82f52)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:13.506673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdd059-3594-4647-bd20-0756e7c11b8e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:13.508230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 586/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Aug 17 07:16:13 2022] GET /identity/v3/domains/de7e097221854b3999eedc9c66a82f52 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:13.514091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:13.547156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:13.609875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6f4b-6668-45c4-9412-5f32db44f389 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:13.642586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:13.643183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:13.643461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:13.643727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:13.644363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:13.645787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740f06-26ed-422f-9c9c-55fb8ea0c906 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:13.671177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 587/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:16:13 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:16:15.570727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b748-cbfe-4836-abae-b68de0f816f5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:15.571376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b748-cbfe-4836-abae-b68de0f816f5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:15.571376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124b748-cbfe-4836-abae-b68de0f816f5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:15.572595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 587/1174] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:15.577692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:15.578155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:15.578258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:15.597074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:15.598263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:15.661653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 588/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:15.931246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124b748-cbfe-4836-abae-b68de0f816f5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:16.012317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:16.029435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124b748-cbfe-4836-abae-b68de0f816f5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:16.061105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:16.061712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:16.062007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:16.062278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] PATH_INFO: `/v3/domains/de7e097221854b3999eedc9c66a82f52` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:16.063357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] RBAC: Authorizing `identity:get_domain(domain_id=de7e097221854b3999eedc9c66a82f52)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:16.064766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c5a80-3b0d-4855-969f-5ec38030feff None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:16.066314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 588/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Aug 17 07:16:15 2022] GET /identity/v3/domains/de7e097221854b3999eedc9c66a82f52 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:16.072070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:16.090201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:16.167410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a36c8f-0269-4fba-bb71-9bce0cfbd3eb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:16.199581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:16.200167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:16.200436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:16.201243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:16.201880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:16.203307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca86823-8084-4a8a-9a0f-e7f8af54f501 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:16.223980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 589/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:16:16 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:16:18.121034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767df5e9-e58b-43fe-ab79-cf797d38ff55 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:18.121576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767df5e9-e58b-43fe-ab79-cf797d38ff55 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:18.121576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767df5e9-e58b-43fe-ab79-cf797d38ff55 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:18.123541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 589/1178] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:18.128735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:18.129118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:18.129275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:18.146919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:18.148104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:18.211863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 590/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:18.480502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767df5e9-e58b-43fe-ab79-cf797d38ff55 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:18.578549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767df5e9-e58b-43fe-ab79-cf797d38ff55 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:18.610241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:18.610851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:18.611128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:18.611404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:18.622844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:16:18.627454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:18.628616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:16:18.629536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 590/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:18.634557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:18.637604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:18.730290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61389-8f97-4fdf-b260-dab5bf14d1e0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:18.763145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:18.763680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:18.763951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:18.764215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:18.764866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:18.765159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:18.766542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:18.774178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 591/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:18.779956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:18.795398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:18.882262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6d534-f644-4597-81d4-6e2e130bf6d9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:18.915434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:18.916056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:18.916334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:18.916601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] PATH_INFO: `/v3/users/82cfe289fdd34d378d3100d471b8be1b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:18.930577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] RBAC: Authorizing `identity:get_user(user_id=82cfe289fdd34d378d3100d471b8be1b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:18.932004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:18.933625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 591/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:16:18 2022] GET /identity/v3/users/82cfe289fdd34d378d3100d471b8be1b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:18.940175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:19.005383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:19.041459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6960213-d8fb-48a1-bd17-dab81426bd2f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:19.073344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:19.073937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:19.074234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:19.074498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:19.137844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:19.139335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:19.199684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:19.234399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 592/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:16:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:16:19.240571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:19.306442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:19.336092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53e8e8-b2a3-4f05-a450-ed4acecfc66b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:19.369598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:19.370249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:19.370524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:19.370790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] PATH_INFO: `/v3/projects/d569fdc22bc64b7491867fe6eecd3c59` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:19.371874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] RBAC: Authorizing `identity:get_project(project_id=d569fdc22bc64b7491867fe6eecd3c59)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:19.373293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d425c-31b6-4e94-8305-7eaedfe71c46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:19.374938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 592/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:16:19 2022] GET /identity/v3/projects/d569fdc22bc64b7491867fe6eecd3c59 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:19.380916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:19.476300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a39a-ae8e-449a-a627-d616e324c0a7 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:19.508698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:19.509286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:19.509562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:19.509829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:19.510581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=d569fdc22bc64b7491867fe6eecd3c59, user.id=82cfe289fdd34d378d3100d471b8be1b) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:19.510886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:19.512288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41413b1e-7ebb-4bae-8c53-a4f33762c23b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:19.518182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 593/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:16:19 2022] GET /identity/v3/role_assignments?user.id=82cfe289fdd34d378d3100d471b8be1b&scope.project.id=d569fdc22bc64b7491867fe6eecd3c59&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:21.363500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b1021-e95b-4573-a113-598834552f51 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:21.363948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b1021-e95b-4573-a113-598834552f51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:21.364061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b1021-e95b-4573-a113-598834552f51 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:21.365371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 593/1186] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:21.370750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:21.371149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:21.371298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:21.388704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:21.389873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:21.412911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:21.454434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 594/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:16:21.716711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b1021-e95b-4573-a113-598834552f51 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:21.813840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b1021-e95b-4573-a113-598834552f51 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:21.845365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:21.845983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:21.846265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:21.846532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:21.852912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:21.856872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:16:21.862824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:21.863967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:16:21.865064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 594/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:21.869676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:21.963977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2070f-563c-4585-ab39-0e9a633f1a83 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:21.996658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:21.997190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:21.997465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:21.997733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:21.998955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:21.999251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:22.000607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:22.008274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 595/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:22.013870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:22.108782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b048e-64c8-4226-ae9b-5a006d18db62 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:22.140704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:22.141307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:22.141582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:22.141852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] PATH_INFO: `/v3/users/82cfe289fdd34d378d3100d471b8be1b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:22.143041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] RBAC: Authorizing `identity:get_user(user_id=82cfe289fdd34d378d3100d471b8be1b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:22.144442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:22.145985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 595/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:16:22 2022] GET /identity/v3/users/82cfe289fdd34d378d3100d471b8be1b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:22.151426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:22.176083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:22.249069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b57010-0ccb-439f-9b88-152afebf6d10 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:22.281092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:22.281705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:22.282003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:22.282276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] PATH_INFO: `/v3/projects/d569fdc22bc64b7491867fe6eecd3c59` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:22.283375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] RBAC: Authorizing `identity:get_project(project_id=d569fdc22bc64b7491867fe6eecd3c59)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:22.284793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066d463-46f9-4898-aa72-998ed4b9663a None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:22.286424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 596/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:16:22 2022] GET /identity/v3/projects/d569fdc22bc64b7491867fe6eecd3c59 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:22.292193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:22.355422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:22.390441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9daa16-2573-4c25-a30d-0788afdeaf46 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:22.425141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:22.425777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:22.426085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:22.426357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] PATH_INFO: `/v3/projects/d569fdc22bc64b7491867fe6eecd3c59/users/82cfe289fdd34d378d3100d471b8be1b/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:22.428213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] RBAC: Authorizing `identity:create_grant(project_id=d569fdc22bc64b7491867fe6eecd3c59, user_id=82cfe289fdd34d378d3100d471b8be1b, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:22.429635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e3302-efde-411f-a434-7f560bed937f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:22.442394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 596/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:16:22 2022] PUT /identity/v3/projects/d569fdc22bc64b7491867fe6eecd3c59/users/82cfe289fdd34d378d3100d471b8be1b/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:16:24.293205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae0c-1746-4c6e-9b6b-2a72f401829a None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:24.293745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae0c-1746-4c6e-9b6b-2a72f401829a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:24.293745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae0c-1746-4c6e-9b6b-2a72f401829a None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:24.295661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 597/1193] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:16:24.300762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:24.301130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:24.301309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:24.318738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:16:24.319916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:16:24.386125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 597/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:16:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:16:24.651187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fae0c-1746-4c6e-9b6b-2a72f401829a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:24.740384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:24.750876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fae0c-1746-4c6e-9b6b-2a72f401829a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:24.784696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:24.785313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:24.785589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:24.785862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:24.795847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:16:24.800519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:16:24.801615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:16:24.802647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 598/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:16:24.807755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:24.861038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:24.903249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec744a-49b3-46ea-8e08-310ed9aec754 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:24.935375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:24.935965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:24.936242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:24.936511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:24.937162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:24.937460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:24.938847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:24.946517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 598/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:24.952733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:25.048920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373885c5-9f90-4ad0-b749-74d9be177de2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:25.081901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:25.082538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:25.082814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:25.083082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] PATH_INFO: `/v3/users/82cfe289fdd34d378d3100d471b8be1b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:25.084179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] RBAC: Authorizing `identity:get_user(user_id=82cfe289fdd34d378d3100d471b8be1b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:25.085601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:25.087176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 599/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Aug 17 07:16:24 2022] GET /identity/v3/users/82cfe289fdd34d378d3100d471b8be1b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:25.092788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:25.188401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc340-1a1b-4a8d-bb2d-2f177f856ea1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:25.204864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:25.220710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:25.221292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:25.221566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:25.221833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:25.285735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:25.287193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:25.381655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 599/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:16:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:16:25.387567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:25.407470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:25.485276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453d04f-e777-4ad1-a356-0bddfc0808ef None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:25.517935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:25.518576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:25.518854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:25.519126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] PATH_INFO: `/v3/projects/d569fdc22bc64b7491867fe6eecd3c59` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:25.520219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] RBAC: Authorizing `identity:get_project(project_id=d569fdc22bc64b7491867fe6eecd3c59)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:25.521642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73d64a-46ee-4826-9121-40b33dbaca7d None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:25.523270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 600/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Aug 17 07:16:25 2022] GET /identity/v3/projects/d569fdc22bc64b7491867fe6eecd3c59 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:25.529866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:16:25.547409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:25.624927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5dc22-77e7-40a5-8c4d-34f0c263ca0f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:16:25.658152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:16:25.658726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:16:25.658998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:16:25.659265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:16:25.659979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=d569fdc22bc64b7491867fe6eecd3c59, user.id=82cfe289fdd34d378d3100d471b8be1b) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:16:25.660280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:16:25.661686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810eb1-052c-4834-95be-daf137d1cee5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:16:25.667247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 600/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:16:25 2022] GET /identity/v3/role_assignments?user.id=82cfe289fdd34d378d3100d471b8be1b&scope.project.id=d569fdc22bc64b7491867fe6eecd3c59&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:16:35.513871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=57 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:16:35.664769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=59 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:20.582523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c049-cff3-4b7c-bb8d-dd1907a12918 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:20.583180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c049-cff3-4b7c-bb8d-dd1907a12918 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:20.583180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95c049-cff3-4b7c-bb8d-dd1907a12918 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:20.585206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 601/1201] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:20.591377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:20.591911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:20.592054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:20.623023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:20.624279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:20.721835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 601/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:21.044276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95c049-cff3-4b7c-bb8d-dd1907a12918 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:21.176877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95c049-cff3-4b7c-bb8d-dd1907a12918 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:21.220918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:21.221625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:21.221906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:21.222207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:21.244230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:21.246468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:21.263082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:21.264296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:21.265302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:21.265302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:21.265302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:21.265302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 602/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:21.270869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:21.397874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9402fe-2c5a-490a-8e6a-59c357eeea8c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:21.438059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:21.445208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973258e-c303-4667-928c-3a392cab705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:21.445812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973258e-c303-4667-928c-3a392cab705d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:21.446370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973258e-c303-4667-928c-3a392cab705d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:21.446648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973258e-c303-4667-928c-3a392cab705d None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:21.447295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973258e-c303-4667-928c-3a392cab705d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:21.447597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973258e-c303-4667-928c-3a392cab705d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:21.448980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973258e-c303-4667-928c-3a392cab705d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:21.465548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 602/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:21.468548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:21.539312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:21.596066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac84cda-189d-4271-8f79-e68ec9e3dfa2 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:21.642247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:21.642885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:21.643275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:21.643544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:21.644396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:21.646159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe4ec3-3458-4c8e-a031-7abc203317c7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:21.683405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 603/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Aug 17 07:17:21 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:17:23.950478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354726-feb4-4f95-aa6c-cbb67928ddaa None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:23.951054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354726-feb4-4f95-aa6c-cbb67928ddaa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:23.951054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354726-feb4-4f95-aa6c-cbb67928ddaa None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:23.952961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 603/1206] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:23.958647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:23.959109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:23.959191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:23.980434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:23.981824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:24.064402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 604/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:24.348647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354726-feb4-4f95-aa6c-cbb67928ddaa None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:24.468789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354726-feb4-4f95-aa6c-cbb67928ddaa None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:24.508344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:24.509275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:24.509563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:24.509829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:24.521702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:24.526731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:24.528372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:24.529293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 604/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:17:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:24.534772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:24.577667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:24.645580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6e647-bb43-4ea1-8a3f-4bbe35383603 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:24.682768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:24.683443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:24.683758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:24.683991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:24.684698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:24.685046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:24.686546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:24.702575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 605/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:17:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:24.703994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:24.764603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:24.828762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a646888-5031-45b0-93b4-ac147690d303 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:24.866529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:24.867246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:24.867564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:24.867889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:24.880316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:24.881899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:24.899106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:24.900479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:24.901413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:24.901413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:24.901413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:24.901413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 605/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:17:24.905881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:25.017871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:25.020904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f2977-4341-4681-94bd-30f23e6a1822 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:25.060981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:25.061637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:25.061982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:25.062320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:25.063035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:25.063344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:25.065023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:25.081122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 606/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:25.087929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:25.211688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93e1aa-0089-4cf7-a5c6-10109f888663 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:25.213790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:25.255539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:25.256160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:25.256483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:25.256764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:25.266700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:25.270645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:25.282645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:25.288725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:25.290004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 606/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:25.290803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:25.418622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b5c3-1f42-4056-8773-2030264e856f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:25.460776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:25.461403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:25.462095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:25.462095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:25.462711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:25.463014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:25.464503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:25.485698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 607/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:25.491203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:25.616326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61333-66e2-499e-b3a8-9ce69d6b834e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:25.653933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:25.654625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:25.654908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:25.655228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:25.688655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:25.735976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:25.737632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:25.857950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 607/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:17:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:17:25.864144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:25.887064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:25.977173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0acd27-f2c6-4d29-9a0c-6cfe4755a4ac None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:26.018169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:26.018799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:26.019044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:26.019297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:26.030454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:26.032180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:26.048980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:26.054753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:26.055916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:26.055916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:26.055916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:26.055916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 608/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:26.056203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:26.121255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:26.163859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6d20-833c-464b-9bd3-9f0b2a707f30 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:26.201037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:26.201651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:26.201925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:26.202218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:26.202852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:26.203146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:26.204490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:26.216771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 608/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:26.222079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:26.297871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:26.332643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874dd9-ab8a-43f3-9e26-d3b4ace1249f None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:26.383087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:26.383844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:26.384222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:26.384486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:26.394631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:26.396419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:26.409077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:26.410179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:26.411123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:26.416127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 609/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:17:26.417145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:26.541652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571b3f-2836-45c0-b0d8-e5a6bebf1fce None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:26.569366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:26.586015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:26.586645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:26.586922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:26.587198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:26.587892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:26.588195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:26.590270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018722c9-674a-4d22-9daf-307fa5e0c445 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:26.605669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 609/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:17:26.612045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:26.718268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab0dc2-57c6-4daf-a8cd-4434c7525460 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:26.749115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:26.755483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:26.756200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:26.756647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:26.756919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:26.757664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=5a1acf20f6174d5c91f37c7da6dd9e47) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:26.757945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:26.759405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac13d0-ec52-489c-b565-31b514243c62 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:26.764853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 610/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:17:26 2022] GET /identity/v3/role_assignments?user.id=5a1acf20f6174d5c91f37c7da6dd9e47&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:28.723144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57593-f803-4067-887c-1c4d4050a2e2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:28.725266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57593-f803-4067-887c-1c4d4050a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:28.725266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57593-f803-4067-887c-1c4d4050a2e2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:28.725266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 610/1220] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:28.730705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:28.731161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:28.731161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:28.750354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:28.751531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:28.825157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 611/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:29.108621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57593-f803-4067-887c-1c4d4050a2e2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:29.216634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57593-f803-4067-887c-1c4d4050a2e2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:29.253987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:29.254898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:29.255169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:29.255435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:29.265266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:29.269975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:29.271111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:29.272170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 611/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:29.277126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:29.384023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcd0c5-23e2-4fac-a0fd-11ee8903615f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:29.407387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:29.418572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:29.419165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:29.419436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:29.419808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:29.420523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:29.420819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:29.422237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:29.430082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 612/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:29.437262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:29.484851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:29.547639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c361057-eb47-4501-ac0c-ca2daf04a07e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:29.582826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:29.583576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:29.583892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:29.584235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:29.597384 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:29.599037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:29.615044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:29.621468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:29.622665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:29.622665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:29.622665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:29.622665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 612/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:29.622962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:29.734683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06e23d-8271-4081-9cca-d1f6f596ffa6 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:29.769979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:29.770625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:29.770952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:29.771186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:29.771877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:29.772194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:29.773589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:29.787304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 613/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:17:29.793704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:29.919117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:29.927751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35749f3-5af3-4f41-a6f5-e61f72440ef7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:29.963745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:29.964985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:29.965311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:29.965558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:29.973294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:29.974756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:29.985753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:29.987179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:29.988670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:29.991829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 613/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:29.993167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.047113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:30.104041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a950ff5-f777-4466-a28e-049111c55422 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:30.141069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:30.141675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:30.142083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:30.142381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:30.143240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:30.143691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:30.145430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:30.166371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 614/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:30.172247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.282998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff1a99-20a0-4b88-8ba7-bd8179624541 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:30.317574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:30.318228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:30.318506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:30.318773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:30.330335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:30.331807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:30.350159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:30.351116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:30.352672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:30.352672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:30.352672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:30.352672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 614/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:30.356923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.466222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c025541-1643-4fc6-8351-5f9303e300ad None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:30.468744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:30.502389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:30.503015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:30.503295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:30.503563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:30.504281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:30.504498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:30.505858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:30.517644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 615/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:30.523426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.535056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:30.637160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7410f-b1fe-4b72-af54-2ad875a45462 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:30.673185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:30.673899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:30.674224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:30.674475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:30.681681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:30.683738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:30.696285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:30.697247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:30.698215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 615/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:30.703197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.825005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f710af-4294-4083-8d56-86a4d421e558 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:30.864670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:30.865272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:30.865550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:30.865815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:30.866534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:30.866833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:30.868552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5f923-6574-447c-a833-fc2206167328 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:30.886433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 616/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:30.887620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:30.957067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:30.995063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88846a36-0dd8-4621-a855-0e608d805fc0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:31.029929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:31.030615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:31.030878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:31.031158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/5a1acf20f6174d5c91f37c7da6dd9e47/roles/c7ec63bc0022429699af1b401b486f17` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:31.047701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=5a1acf20f6174d5c91f37c7da6dd9e47, role_id=c7ec63bc0022429699af1b401b486f17)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:31.049291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e13508-9e39-42dc-8777-98d6d9634145 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:31.061906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 616/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:17:30 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/5a1acf20f6174d5c91f37c7da6dd9e47/roles/c7ec63bc0022429699af1b401b486f17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:17:32.972031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce085-74da-4267-8119-ba0d52a7a65c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:32.972558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce085-74da-4267-8119-ba0d52a7a65c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:32.972558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fce085-74da-4267-8119-ba0d52a7a65c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:32.973890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 617/1233] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:32.979316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:32.980275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:32.980398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:32.998763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:32.999948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:33.074194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 617/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:33.339607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fce085-74da-4267-8119-ba0d52a7a65c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:33.371104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:33.452381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fce085-74da-4267-8119-ba0d52a7a65c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:33.491057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:33.491678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:33.491958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:33.492223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:33.504370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:33.509539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:33.510607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:33.515000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 618/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Aug 17 07:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:33.517206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:33.568176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:33.628435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026161a-be0f-4e87-ab29-b4efc5c12556 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:33.666112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:33.666839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:33.667113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:33.667381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:33.668036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:33.668329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:33.669695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:33.677926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 618/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Aug 17 07:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:33.683864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:33.776193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:33.792770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ab19c-c68c-492e-941a-e56f7b27045c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:33.829861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:33.830513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:33.830787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:33.831050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:33.843405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:33.845027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:33.861990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:33.863542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:33.864681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:33.864681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:33.864681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:33.864681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 619/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:33.869785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:33.976838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf096-d8bd-4451-bcbe-ab5e577b61b8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:33.988029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:34.017449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:34.018110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:34.018378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:34.018648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:34.019344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:34.019650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:34.021013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:34.032997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 619/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:34.039205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:34.149908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a81fb-1470-4f35-95b7-9dbd32f47a6c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:34.184494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:34.185075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:34.185367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:34.185623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:34.188507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:34.193893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:34.195648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:34.208107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:34.209426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:34.210490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 620/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:34.215590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:34.319640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1727c-31fa-43ec-a2e4-67714e0761f1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:34.356516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:34.357112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:34.357387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:34.357652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:34.358403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:34.358703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:34.360112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:34.382488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 620/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:17:34.389439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:34.498066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd96560-63b1-4e7b-a9da-d94f6a58bcdf None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:34.533785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:34.534527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:34.534805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:34.535075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:34.601450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:34.608769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:34.610278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:34.712351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 621/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:17:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:17:34.718344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:34.747819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:34.827502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4cc65-8efd-4625-aa0b-2ccbd2027cec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:34.865804 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:34.866261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:34.866544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:34.866821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:34.883745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:34.885546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:34.903695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:34.904912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:34.906228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:34.906228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:34.906228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:34.906228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 621/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:34.911063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:35.007005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:35.013340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83053c6-eb87-4fb4-8a05-ea89558c4262 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:35.058388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:35.059053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:35.059262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:35.059533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:35.060186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:35.060450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:35.061935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:35.074672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 622/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:35.080624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:35.171968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:35.194667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767b7d-1574-4776-8246-0806d593b87a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:35.241815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:35.242672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:35.243075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:35.243483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:35.251004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:35.252438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:35.265568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:35.266775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:35.268383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 622/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:17:35.272581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:35.383995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750835c2-7fc1-4db9-9ec2-81e3e8b8c910 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:35.420264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:35.420907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:35.421189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:35.421463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:35.422292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:35.422553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:35.424244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8984b79-6cd9-49dc-b373-cc8952d6c1cf None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:35.437436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 623/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:35.443837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:35.566226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef8d40-3a91-4e72-9d4f-c716bc2df3c2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:35.601077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:35.601709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:35.602060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:35.602354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:35.603068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] RBAC: Adding query filter params (role.id=c7ec63bc0022429699af1b401b486f17, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=5a1acf20f6174d5c91f37c7da6dd9e47) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:35.603454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:35.604993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e7f67-8429-465a-8aaa-de8ac960d021 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:35.611060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 623/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:17:35 2022] GET /identity/v3/role_assignments?user.id=5a1acf20f6174d5c91f37c7da6dd9e47&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=c7ec63bc0022429699af1b401b486f17 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:37.670441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71811-e359-407d-a378-5043e473ead9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:37.670943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71811-e359-407d-a378-5043e473ead9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:37.670943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71811-e359-407d-a378-5043e473ead9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:37.672253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 624/1247] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:37.677729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:37.678188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:37.678389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:37.685159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:37.699915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:37.701102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:37.778976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 624/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:17:38.071068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac71811-e359-407d-a378-5043e473ead9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:38.092023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:38.193933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac71811-e359-407d-a378-5043e473ead9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:38.234040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:38.234662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:38.234941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:38.235270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:38.247422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:38.252372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:38.253602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:38.255081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 625/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:38.259908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:38.372462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d1348-4af6-4a26-9ff3-4b6c1a2fc5b1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:38.403645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:38.409262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:38.409857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:38.410182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:38.410519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:38.411242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:38.411545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:38.412984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:38.422257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 625/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:38.427966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:38.514400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:38.541098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1f6f-e3a1-4e39-80ac-54b8a4c5d900 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:38.583906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:38.585053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:38.585305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:38.585595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:38.597070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:38.598570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:38.615309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:38.616451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:38.617550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:38.617550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:38.617550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:38.619198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 626/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:38.625852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:38.732125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01dac7-afe5-4cd2-a3d6-b7f2c374694d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:38.776038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:38.776664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:38.776939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:38.777204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:38.777854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:38.778186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:38.779547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:38.792404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 626/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:38.798968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:38.921038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3735c94-cecb-46e6-8601-6e3eed984346 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:38.949889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:38.959584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:38.960293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:38.960627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:38.960941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:38.969929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:38.971396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:38.983637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:38.989717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:38.990960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 627/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:38.991698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:39.060407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:39.111376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49d77-29f4-4d4a-881f-f09a81739ec0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:39.149649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:39.150373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:39.150630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:39.150880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:39.151598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:39.151898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:39.153395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:39.171349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 627/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:39.177055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:39.285088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec0ab6-3d3e-4ff7-a940-5164d85ecc25 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:39.321813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:39.322524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:39.322828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:39.323231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:39.394634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:39.409307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:39.410809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:39.515830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 628/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:17:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:17:39.521580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:39.627841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaf7a0-e719-4abe-aba2-b79a168ee4a4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:39.644083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:39.666225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:39.666913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:39.667333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:39.667681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:39.678766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:39.680630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:39.696736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:39.697917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:39.699543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:39.699543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:39.699543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:39.699543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 628/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 07:17:39.704128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:39.800445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:39.815359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533058-dc49-4872-bb15-ee9c305339fe None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:39.857321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:39.857923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:39.858228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:39.858499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:39.859137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:39.859440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:39.860794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:39.872517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 629/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:17:39.878231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:39.993108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2743-dfe4-4bbe-a8bd-882b76e7c8eb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:40.030892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:40.031549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:40.031825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:40.032096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:40.041201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:40.042746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:40.055068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:40.056280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:40.057215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 629/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:40.062953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:40.167649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21519b-4191-4b59-800b-e68720fbf98c None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:40.204649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:40.205273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:40.205550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:40.205818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:40.206552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:40.206853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:40.208339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c30ef-77cf-4089-9a47-b35c4546bded None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:40.221527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 630/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:40.227953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:40.255247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:40.333689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d521dd-f19c-4b5c-9e38-2828fdfbcb84 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:40.371277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:40.371892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:40.372170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:40.372440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:40.373174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=5a1acf20f6174d5c91f37c7da6dd9e47) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:40.373481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:40.374958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74943f-e6cd-40b5-9a32-d01ec6de48b2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:40.381276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 630/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:17:40 2022] GET /identity/v3/role_assignments?user.id=5a1acf20f6174d5c91f37c7da6dd9e47&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:42.225477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6fb3-6ef0-4485-8922-05cf4677fcc8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:42.226096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6fb3-6ef0-4485-8922-05cf4677fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:42.226096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6fb3-6ef0-4485-8922-05cf4677fcc8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:42.227356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 631/1261] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:42.232915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:42.233282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:42.233464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:42.251823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:42.252993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:42.316743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 631/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:42.580346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6fb3-6ef0-4485-8922-05cf4677fcc8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:42.591510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:42.678832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6fb3-6ef0-4485-8922-05cf4677fcc8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:42.711357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:42.711958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:42.712229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:42.712496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:42.723012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:42.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:42.728814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:42.729912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 632/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:42.734583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:42.752310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:42.834363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6df40-0f28-42dd-b2e8-7c9a48e4a7a9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:42.870271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:42.870948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:42.871275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:42.871549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:42.872213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:42.872514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:42.873874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:42.881817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 632/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:42.888010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:42.952781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:42.985147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac0b0-945e-4d4c-9555-ce1b56d7e544 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.018528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.019136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.019411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.019679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.029324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.030789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:43.044779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:43.045926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:43.047163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:43.047163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:43.047163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:43.047163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 633/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:43.051492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.131062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:43.153039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781e42c-59aa-4ac7-b213-ee4793c27f12 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.185394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.186003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.186283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.186552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.187179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:43.187478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.188842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.200815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 633/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:43.206463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.302568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd2f7-0084-41bc-8217-00f132568a46 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.321727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:43.336595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.337209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.337484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.337750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.344953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.346432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:43.357379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:43.358544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:43.359544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 634/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:43.364700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.461699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40225d6-b5db-49b0-b93d-c4fe9bc021f0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.495842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.496425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.496699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.496968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.497680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:43.497999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.499415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.507633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:43.516359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 634/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:43.522035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.618588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c4ffe-0dd9-4623-8cfa-96341e20aa4b None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.650820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.651454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.651732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.652004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.662058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.663483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:43.677430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:43.678547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:43.679620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:43.679620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:43.679620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:43.679620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 635/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:43.684709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.779210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60d9f-9722-4b06-864c-d9332f6d0ba6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.816533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.817197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.817533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.817851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.818673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:43.819035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.820604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.834385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 635/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:43.840581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:43.871599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:43.938537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c56077-52fb-4e30-9a89-dd98ce0243e8 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:43.970461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:43.971067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:43.971405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:43.971680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:43.978004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:43.980018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:43.991144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:43.992225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:43.993302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 636/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:43.997803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:44.054622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:44.095233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeaab4-ef52-456c-8fe5-ac4026a603b1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:44.127964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:44.128548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:44.128818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:44.129081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:44.129754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:44.130078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:44.131477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ee0d-502e-4753-a2b8-97ae232c5446 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:44.143430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 636/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:44.149445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:44.237682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:44.246419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd52654-e75c-4888-8f72-df4a42250ec3 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:44.279126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:44.279765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:44.280043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:44.280317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] PATH_INFO: `/v3/projects/62678f101b3547859f187a24aa31f563/users/5a1acf20f6174d5c91f37c7da6dd9e47/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:44.282190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] RBAC: Authorizing `identity:create_grant(project_id=62678f101b3547859f187a24aa31f563, user_id=5a1acf20f6174d5c91f37c7da6dd9e47, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:44.283613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8f037-2fa2-4f31-aa35-1733cfe0b315 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:44.295466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 637/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Aug 17 07:17:44 2022] PUT /identity/v3/projects/62678f101b3547859f187a24aa31f563/users/5a1acf20f6174d5c91f37c7da6dd9e47/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:17:46.157146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806209-0196-4429-8df1-fdc18bb5dd40 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:46.157668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806209-0196-4429-8df1-fdc18bb5dd40 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:46.157668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806209-0196-4429-8df1-fdc18bb5dd40 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:46.159068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 637/1274] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:46.164187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:46.164602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:46.164731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:46.182700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:46.183862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:46.247118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 638/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:46.520592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806209-0196-4429-8df1-fdc18bb5dd40 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:46.618289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806209-0196-4429-8df1-fdc18bb5dd40 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:46.634621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:46.652146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:46.652761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:46.653039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:46.653306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:46.662940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 07:17:46.667603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:46.668710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:46.669668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 638/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Aug 17 07:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:46.674604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:46.752917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:46.771391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f18d2-0a2b-425e-ac57-a2fa79201096 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:46.804761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:46.805356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:46.805538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:46.805805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:46.806503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:46.806801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:46.808901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:46.817647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 639/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Aug 17 07:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:46.823963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:46.926977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799663-80fb-4e73-9820-5dff65d326c3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:46.960382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:46.960992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:46.961268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:46.961537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:46.971093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:46.972521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:46.987540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:46.988676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:46.989626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:46.989626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:46.989626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:46.989626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 639/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:46.994516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:47.090696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a696c-47bd-42ff-a8b4-c8e7c7c562d5 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:47.122917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:47.123505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:47.123783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:47.124051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:47.124683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:47.124981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:47.126370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:47.138164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 640/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:47.143679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:47.173339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:47.239692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d138c-9163-4b85-81a5-f4edda5dd9ee None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:47.271609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:47.272222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:47.272498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:47.272768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:47.279846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:47.281291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 07:17:47.292426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:47.293472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:47.294499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 640/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:47.299291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:47.303021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:47.395227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1c441-5916-4c70-81b2-772539084f93 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:47.428190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:47.428779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:47.429057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:47.429324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:47.430064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:47.430363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:47.431766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:47.448291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 641/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Aug 17 07:17:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:47.453947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:47.542120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:47.551434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03379-ffb4-469a-aec7-40b16739df84 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:47.582662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:47.583244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:47.583520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:47.583787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:47.647146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:47.648507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:47.732339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:47.742622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 641/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Aug 17 07:17:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 07:17:47.748373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:47.810814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:47.851857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cde8f6-d933-4ebe-866c-43843a776440 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:47.884609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:47.885710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:47.886002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:47.886274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:47.895797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:47.897280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 07:17:47.911691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:47.912816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 07:17:47.913760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 07:17:47.913760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 07:17:47.913760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:47.913760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 642/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:47.918504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:48.012769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d1c62-a983-474b-b49f-f9769930179b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:48.045194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:48.045776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:48.046076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:48.046342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:48.046963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:48.047256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:48.048596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:48.059329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 642/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Aug 17 07:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:48.064708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:48.160836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec636e-a127-4c93-b767-0f4c70edf069 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:48.173607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:48.193114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:48.193727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:48.194024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:48.194293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:48.201126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:48.202580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 07:17:48.213285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:48.214989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: ERROR keystone.server.flask.application Aug 17 07:17:48.216184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 643/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Aug 17 07:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:48.220647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:48.268917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:48.316304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff328-1d4c-4d63-a93a-e7b3b7ef31a1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:48.347970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:48.348557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:48.348829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:48.349094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:48.349767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:48.350091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:48.351499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de3afa-4180-4eab-97c5-f8ea28ef4ab6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:48.363455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 643/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Aug 17 07:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:48.369444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:48.465500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb808-a5b1-47cc-b842-9f3b8a0f7685 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:48.498154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:48.498740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:48.499016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:48.499284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:48.500000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] RBAC: Adding query filter params (role.id=94848c028a4945b3b8f06d5afa9dc987, scope.project.id=62678f101b3547859f187a24aa31f563, user.id=5a1acf20f6174d5c91f37c7da6dd9e47) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:48.500312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:48.501731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b0cc7-b6dd-401c-b3cd-93ee2385ca8e None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:48.507298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 644/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Aug 17 07:17:48 2022] GET /identity/v3/role_assignments?user.id=5a1acf20f6174d5c91f37c7da6dd9e47&scope.project.id=62678f101b3547859f187a24aa31f563&role.id=94848c028a4945b3b8f06d5afa9dc987 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:50.403725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1995c-0f55-4cf7-b82c-47ffc828b7c3 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:50.404175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1995c-0f55-4cf7-b82c-47ffc828b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:50.404286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1995c-0f55-4cf7-b82c-47ffc828b7c3 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:50.405596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 644/1288] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:50.410796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:50.411190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:50.411325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:50.428714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:50.429877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:50.458348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:50.494986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 645/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:50.755850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1995c-0f55-4cf7-b82c-47ffc828b7c3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:50.865130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1995c-0f55-4cf7-b82c-47ffc828b7c3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:50.878250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:50.901815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:50.902467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:50.902744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:50.903014 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:50.903589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:50.904946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:50.913517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:50.914791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:50.915996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 645/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:17:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:50.921139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:51.017671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d465e9c-ed1b-4d75-8f09-925bc21bc0f3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:51.049586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:51.050198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:51.050474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:51.050737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:51.051349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:51.051643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:51.052988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e226de0-83d4-470a-b218-7016291a96db None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:51.058329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 646/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 17 07:17:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:51.063621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:51.165555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35a042-2a8f-4838-8d98-9119db1d7936 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:51.198317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:51.198904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:51.199182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:51.199452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:51.200071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:51.200371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:51.201725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80d1e4-2da0-4b6d-9dc6-cf63a91feffc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:51.205988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 646/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 17 07:17:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:53.061441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76daa7-663e-4f36-abcc-69cf19ecca70 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:53.061986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76daa7-663e-4f36-abcc-69cf19ecca70 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:53.061986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76daa7-663e-4f36-abcc-69cf19ecca70 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:53.063326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 647/1293] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:53.068290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632faed-3c98-44d6-b066-92ce195c1647 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:53.068727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632faed-3c98-44d6-b066-92ce195c1647 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:53.068822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632faed-3c98-44d6-b066-92ce195c1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:53.087599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1632faed-3c98-44d6-b066-92ce195c1647 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:53.088821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1632faed-3c98-44d6-b066-92ce195c1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:53.117538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:53.154574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 647/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 07:17:53.416935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76daa7-663e-4f36-abcc-69cf19ecca70 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:53.446616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:53.514835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76daa7-663e-4f36-abcc-69cf19ecca70 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:53.546245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:53.546829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:53.547100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:53.547366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:53.547985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:53.549334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f8b26-0888-4ad8-90d4-2b0a90dbabe8 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:53.563125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 648/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Aug 17 07:17:53 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:17:55.463790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36919-6045-48b3-b2f4-3b020a939cb2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:55.464291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36919-6045-48b3-b2f4-3b020a939cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:55.464396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36919-6045-48b3-b2f4-3b020a939cb2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:55.465673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 648/1296] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:55.470824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:55.471254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:55.471366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:55.488908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:55.490092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:55.559420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 649/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:55.835111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36919-6045-48b3-b2f4-3b020a939cb2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:55.945375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36919-6045-48b3-b2f4-3b020a939cb2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:55.978082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:55.978719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:55.979003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:55.979270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:55.979837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:55.981193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:55.989913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:55.991112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:55.992174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 649/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:17:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:55.997669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:56.015779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:56.093657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677060-7c70-4b85-9ef9-c1c584b1db12 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:56.126115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:56.126702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:56.126976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:56.127241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:56.127857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:56.128149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:56.129505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:56.134390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 650/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 17 07:17:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:17:56.140723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:56.171568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:56.237064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4514f3-9aa7-4b62-93dc-700de3d69ecd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:56.269318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:56.269901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:56.270204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:56.270474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:56.271156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] RBAC: Adding query filter params (interface=public, service_id=2f91812731324504bf161daee292b3e6, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:56.271460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:56.272806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0e520-d5f9-4fbc-808c-ba80ec5f3767 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:56.278249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 650/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Aug 17 07:17:56 2022] GET /identity/v3/endpoints?service_id=2f91812731324504bf161daee292b3e6&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:56.283776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:56.362049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:56.379935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6052fa4-31c9-417f-8d6e-8a99fcf45189 None admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:56.412700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:56.413288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:56.413559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:56.413823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:56.414443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:56.415787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d25af-8e6a-4fe6-9fda-4a2c2362bf98 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:56.422277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 651/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Aug 17 07:17:56 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:17:58.276628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea8f0-4e5f-4a23-b5f7-a1eeacc4f6df None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:58.277194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea8f0-4e5f-4a23-b5f7-a1eeacc4f6df None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:58.277194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ea8f0-4e5f-4a23-b5f7-a1eeacc4f6df None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:58.278538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 651/1302] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:17:58.283498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:58.283907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:58.284047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:58.301558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:17:58.302777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:17:58.367914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 652/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:17:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 07:17:58.634383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea8f0-4e5f-4a23-b5f7-a1eeacc4f6df None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:58.726031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:58.733286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ea8f0-4e5f-4a23-b5f7-a1eeacc4f6df None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:58.765518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:58.766156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:58.766436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:58.766705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:58.767272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:58.768617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 07:17:58.777528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 07:17:58.778587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 17 07:17:58.779475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 652/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Aug 17 07:17:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 07:17:58.784502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:58.859204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:17:58.882521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f64959-4651-4340-b609-79e6ad9e5891 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:58.915334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:58.915880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:58.916183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:58.916451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] PATH_INFO: `/v3/services` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:58.917073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:17:58.917371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:58.918762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93b245-d5ca-4312-b081-b929f7c3efa7 None admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:58.923689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 653/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Aug 17 07:17:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:17:58.929496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:17:59.026852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495cd1-f3a1-44b8-8257-ff5eaac2d231 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:17:59.059220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:17:59.059802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:17:59.060081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:17:59.060352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:17:59.060998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:17:59.062416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530979ce-5ff6-4d10-bda0-accada7e8436 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:17:59.081436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 653/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:17:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:18:08.920751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=30 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:18:09.077260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:01.787085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f30f-d20d-4b39-8384-28140885c179 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:01.787672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f30f-d20d-4b39-8384-28140885c179 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:01.787672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0f30f-d20d-4b39-8384-28140885c179 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:01.792881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 654/1307] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:01.794454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17281-1210-45cc-be96-309022ac649d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:01.795216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17281-1210-45cc-be96-309022ac649d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:01.795640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee17281-1210-45cc-be96-309022ac649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:01.962997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9ee17281-1210-45cc-be96-309022ac649d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:01.964570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9ee17281-1210-45cc-be96-309022ac649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:02.199462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 654/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:19:02.501356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:02.501700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:02.501913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:02.503424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 655/1309] 10.222.0.45 () {54 vars in 965 bytes} [Wed Aug 17 07:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:02.510347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4c8-2151-4e4d-bbbf-8432539fd1d6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:02.510957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4c8-2151-4e4d-bbbf-8432539fd1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:02.511475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ee4c8-2151-4e4d-bbbf-8432539fd1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:02.595775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2e8ee4c8-2151-4e4d-bbbf-8432539fd1d6 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:02.597035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2e8ee4c8-2151-4e4d-bbbf-8432539fd1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:02.621406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:02.687329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 655/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Wed Aug 17 07:19:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:02.697201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:02.699440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:02.815356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2011-5a7b-4820-b76a-28cc579cc0ee None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:02.895905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:02.896752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:02.897180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:02.897618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:02.899431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:02.985427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:03.065923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:03.067453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963a3d-eb04-4f8b-80a2-f5ac75a59735 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:03.091117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 656/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:05.290553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:05.291117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:05.291117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:05.292456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 656/1312] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:05.297577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb58a3-10e7-4800-9315-6eace472bf2e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:05.298038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb58a3-10e7-4800-9315-6eace472bf2e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:05.298221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb58a3-10e7-4800-9315-6eace472bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:05.371868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-efbb58a3-10e7-4800-9315-6eace472bf2e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:05.373175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-efbb58a3-10e7-4800-9315-6eace472bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:05.469938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 657/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:05.751781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:05.753393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:05.857953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bcf9-3e19-4610-bda5-52732099078d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:05.932037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:05.934903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:05.935613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:05.936068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:05.936520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:05.938151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:06.046521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:06.047934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d320b7b-e317-49c1-9b1c-2d5f0c5c7202 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:06.065604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 657/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:08.249566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:08.250106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:08.250226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:08.251510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 658/1315] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:08.256513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59704-e93d-4f77-8f62-7413c9a32e43 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:08.256976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59704-e93d-4f77-8f62-7413c9a32e43 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:08.257089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d59704-e93d-4f77-8f62-7413c9a32e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:08.322154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-92d59704-e93d-4f77-8f62-7413c9a32e43 None None] MFA Rules not processed for user `123dc2eb7c274f66afcf8d8f76978485`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:08.323348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-92d59704-e93d-4f77-8f62-7413c9a32e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:08.374581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:08.418560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 658/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:08.712520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:08.714092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:08.723786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:08.815965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21e009-ba4f-46a9-af95-c697d28242f8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:08.887238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:08.887836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:08.888111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:08.888378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:08.889955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:08.950243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:08.995753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:08.997155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091d453-2687-47aa-a390-b79cbb5c6889 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:09.015391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 659/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:11.465192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd19-6772-4ea2-b08b-acfdb3ea94c1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:11.465749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd19-6772-4ea2-b08b-acfdb3ea94c1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:11.465749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd19-6772-4ea2-b08b-acfdb3ea94c1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:11.467129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 659/1318] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:11.472258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3dd8e-ae9a-4d75-aeb3-6867c0fd8e96 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:11.472636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3dd8e-ae9a-4d75-aeb3-6867c0fd8e96 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:11.472802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3dd8e-ae9a-4d75-aeb3-6867c0fd8e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:11.537483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-31a3dd8e-ae9a-4d75-aeb3-6867c0fd8e96 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:11.539285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31a3dd8e-ae9a-4d75-aeb3-6867c0fd8e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:11.633184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 660/1319] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:11.932922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:11.933203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:11.933474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:11.934897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 660/1320] 10.222.0.45 () {54 vars in 965 bytes} [Wed Aug 17 07:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:11.940953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0755f1-59f8-45c0-a723-e7ed417172ca None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:11.941235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0755f1-59f8-45c0-a723-e7ed417172ca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:11.941520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0755f1-59f8-45c0-a723-e7ed417172ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:11.966515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:12.018833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ca0755f1-59f8-45c0-a723-e7ed417172ca None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:12.020058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ca0755f1-59f8-45c0-a723-e7ed417172ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:12.094562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 661/1321] 10.222.0.45 () {58 vars in 1062 bytes} [Wed Aug 17 07:19:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:12.103711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:12.105230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:12.205955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1ea8-6e29-46c9-abf9-f474641902a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:12.278425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:12.279062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:12.279337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:12.279605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:12.281198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:12.288466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:12.388929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:12.390421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6588050-b357-4113-aa4c-588f13eac123 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:12.408489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 661/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:19:15.402937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:15.403473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:15.403473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:15.404831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 662/1323] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:15.410270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5036e8c-a4d6-4f24-8926-99904fdcf775 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:15.410712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5036e8c-a4d6-4f24-8926-99904fdcf775 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:15.410869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5036e8c-a4d6-4f24-8926-99904fdcf775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:15.475348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d5036e8c-a4d6-4f24-8926-99904fdcf775 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:15.476530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d5036e8c-a4d6-4f24-8926-99904fdcf775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:15.534239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:15.575059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 662/1324] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:15.857100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:15.858668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:15.962219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e609fd-6033-4169-ade7-b6b4b8d50940 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:15.974221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:16.035725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:16.036221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:16.036495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:16.036764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:16.038923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:16.144517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:16.145972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513e4f2-0eca-45a0-8678-af34ab6296be service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:16.165193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 663/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:18.112325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:18.112935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:18.112935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:18.114146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 663/1326] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:18.119777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84b77-3c5f-4218-a508-9fac63ddce27 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:18.120205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84b77-3c5f-4218-a508-9fac63ddce27 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:18.120321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f84b77-3c5f-4218-a508-9fac63ddce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:18.169009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:18.187987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-10f84b77-3c5f-4218-a508-9fac63ddce27 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:18.189210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-10f84b77-3c5f-4218-a508-9fac63ddce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:18.286870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 664/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:18.569879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:18.571504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:18.698051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508bca-1d1f-43da-8578-45b977663638 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:18.770247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:18.770851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:18.771126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:18.771397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:18.773588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:18.790126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:18.881870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:18.883336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63419c-3588-4e35-82d6-97f75682934f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:18.901416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 664/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:20.851540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:20.852119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:20.852119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:20.853478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 665/1329] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:20.859444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed904-a6d0-472e-b9a7-8234522edb0a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:20.860000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed904-a6d0-472e-b9a7-8234522edb0a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:20.860000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fed904-a6d0-472e-b9a7-8234522edb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:20.925409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c8fed904-a6d0-472e-b9a7-8234522edb0a None None] MFA Rules not processed for user `123dc2eb7c274f66afcf8d8f76978485`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:20.926658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c8fed904-a6d0-472e-b9a7-8234522edb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:20.989940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:21.022736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 665/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:21.302902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:21.305028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:21.413496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9ed8-bd93-41d3-b519-2566ed9c0e57 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:21.433885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:21.487831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:21.488363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:21.488637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:21.488904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:21.490530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:21.597495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:21.598984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcde8ac-bea4-4b84-8f6b-40dad5e248f6 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:21.618831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 666/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:23.794899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:23.795465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:23.795465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:23.796793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 666/1332] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:23.801942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e098d-9d96-41d3-96b2-07641981f023 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:23.802430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e098d-9d96-41d3-96b2-07641981f023 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:23.802527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e098d-9d96-41d3-96b2-07641981f023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:23.866094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:23.869100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ce7e098d-9d96-41d3-96b2-07641981f023 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:23.870641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ce7e098d-9d96-41d3-96b2-07641981f023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:23.965729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 667/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:24.249459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:24.251020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:24.354783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda547f-a096-4254-9fcb-fcdd162c831a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:24.427259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:24.427862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:24.428649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:24.428906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:24.430528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:24.457179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:24.537641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:24.539101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304378a4-abe2-42d1-9109-53ee3b37c21e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:24.557124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 667/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:26.480142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:26.480700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:26.480700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:26.482070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 668/1335] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:26.487389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f491b7-34f1-4bf8-90b3-2b3577068231 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:26.487821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f491b7-34f1-4bf8-90b3-2b3577068231 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:26.487934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f491b7-34f1-4bf8-90b3-2b3577068231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:26.552554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f4f491b7-34f1-4bf8-90b3-2b3577068231 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:26.553789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f4f491b7-34f1-4bf8-90b3-2b3577068231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:26.627139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:26.649626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 668/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:26.932633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:26.934187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:27.037303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895dfb-5316-4836-843e-ae9a0a382e6e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:27.064023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:27.107830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:27.108415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:27.108685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:27.108946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:27.110532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:27.215412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:27.216841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e447fa-176d-446b-b944-5bd291494a2f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:27.234707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 669/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:29.455610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:29.456105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:29.456235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:29.457494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 669/1338] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:29.462563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223efe-5914-490a-97c9-581885146b9a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:29.462980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223efe-5914-490a-97c9-581885146b9a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:29.463106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50223efe-5914-490a-97c9-581885146b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:29.529569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-50223efe-5914-490a-97c9-581885146b9a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:29.530802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50223efe-5914-490a-97c9-581885146b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:29.539462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:29.625832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 670/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:29.913353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:29.914942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:30.018057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4403302-7a1a-464d-83b1-dca7307a798f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:30.091551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:30.092151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:30.092420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:30.092686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:30.094289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:30.127858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:30.200237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:30.201643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5b39a-6db1-4e98-be5b-e562663620f8 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:30.219431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 670/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:33.945844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:33.946464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:33.946464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:33.947751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 671/1341] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:33.953004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102d7b-d6eb-4475-931e-212032fca150 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:33.953433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102d7b-d6eb-4475-931e-212032fca150 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:33.953542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e102d7b-d6eb-4475-931e-212032fca150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:34.018463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4e102d7b-d6eb-4475-931e-212032fca150 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:34.019658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4e102d7b-d6eb-4475-931e-212032fca150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:34.105362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:34.117297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 671/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:34.409481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:34.410992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:34.516230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f558dc-047e-40e7-9c9e-82a69b56c1d5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:34.553073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:34.589033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:34.589630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:34.589899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:34.590192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:34.591763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:34.700269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:34.701726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09baebc-9fbb-4c61-ad91-6805793e9761 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:34.720499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 672/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:19:37.369929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769f97-1d86-4293-83b9-c503383d399c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:37.370501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769f97-1d86-4293-83b9-c503383d399c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:37.370501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769f97-1d86-4293-83b9-c503383d399c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:37.375422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 672/1344] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:37.377663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8156de-7e14-4702-b754-5f9d9e958ccd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:37.378158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8156de-7e14-4702-b754-5f9d9e958ccd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:37.378270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8156de-7e14-4702-b754-5f9d9e958ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:37.442926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2b8156de-7e14-4702-b754-5f9d9e958ccd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:37.444656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2b8156de-7e14-4702-b754-5f9d9e958ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:37.463378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:37.541383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 673/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:37.825136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de769f97-1d86-4293-83b9-c503383d399c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:37.826740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-de769f97-1d86-4293-83b9-c503383d399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:37.934175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de769f97-1d86-4293-83b9-c503383d399c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:38.011328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:38.011911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:38.012185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:38.012480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:38.014089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:38.058258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:38.126450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:38.127785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca01c25-1304-42de-b589-e6d6adecbdff service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:38.146706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 673/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:42.230825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:42.231370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:42.231370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:42.232908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 674/1347] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:42.238511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebe8-926c-4ca4-bac9-4036db5c4f30 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:42.238973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebe8-926c-4ca4-bac9-4036db5c4f30 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:42.239071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebe8-926c-4ca4-bac9-4036db5c4f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:42.315529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9defebe8-926c-4ca4-bac9-4036db5c4f30 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:42.316810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9defebe8-926c-4ca4-bac9-4036db5c4f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:42.430447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:42.433234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 674/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:19:42.713510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:42.715087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:42.819381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db1d4-2916-4c6e-a468-5e841cbf11bd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:42.866396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:42.891563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:42.892176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:42.892434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:42.892700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:42.894310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:43.000279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:43.001702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805d5f4-3c05-4542-ba31-f71815ad8f77 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:43.020076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 675/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:19:47.845845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246fa22-9ad0-4bdd-9787-47f0243f1acb None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:47.845845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246fa22-9ad0-4bdd-9787-47f0243f1acb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:47.846745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246fa22-9ad0-4bdd-9787-47f0243f1acb None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:47.848634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 675/1350] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:47.854075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959ed-8863-4900-9d43-53ff999dc6cb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:47.854540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959ed-8863-4900-9d43-53ff999dc6cb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:47.854638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959ed-8863-4900-9d43-53ff999dc6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:47.959259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ea3959ed-8863-4900-9d43-53ff999dc6cb None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:47.960443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ea3959ed-8863-4900-9d43-53ff999dc6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:47.979746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:48.129653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 676/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:19:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:52.249704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f388-7025-4b7d-98c8-1be8623efb1b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:52.250333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f388-7025-4b7d-98c8-1be8623efb1b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:52.250705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f388-7025-4b7d-98c8-1be8623efb1b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:52.254330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 676/1352] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:19:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:52.260540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a83f-7713-4e38-af5e-884fbb08f03e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:52.261036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a83f-7713-4e38-af5e-884fbb08f03e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:52.261120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09a83f-7713-4e38-af5e-884fbb08f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:52.339548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2d09a83f-7713-4e38-af5e-884fbb08f03e None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:52.340751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2d09a83f-7713-4e38-af5e-884fbb08f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:52.422082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:52.459750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 677/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:19:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:53.726752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351bf2-6a26-4351-a5d1-d1bfbdb964c4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:53.727274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351bf2-6a26-4351-a5d1-d1bfbdb964c4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:53.727274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01351bf2-6a26-4351-a5d1-d1bfbdb964c4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:53.728642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 677/1354] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:53.733624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2bc6-12dd-40b3-b5e4-1d2e40ecfd2b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:53.734087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2bc6-12dd-40b3-b5e4-1d2e40ecfd2b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:53.734194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd2bc6-12dd-40b3-b5e4-1d2e40ecfd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:53.809007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4bcd2bc6-12dd-40b3-b5e4-1d2e40ecfd2b None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:53.810329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4bcd2bc6-12dd-40b3-b5e4-1d2e40ecfd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:53.914305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 678/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:19:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:19:57.309220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af568c-b843-461f-80df-93fdf198f621 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:57.309790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af568c-b843-461f-80df-93fdf198f621 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:57.309790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af568c-b843-461f-80df-93fdf198f621 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:57.311135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 678/1356] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:57.316203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3989-74e5-492f-8ccf-a9f0444524c2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:57.316626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3989-74e5-492f-8ccf-a9f0444524c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:57.316749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3989-74e5-492f-8ccf-a9f0444524c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:57.369513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:57.406448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cece3989-74e5-492f-8ccf-a9f0444524c2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:57.407629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cece3989-74e5-492f-8ccf-a9f0444524c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:57.535732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 679/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:57.839056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:57.839734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:57.840219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:57.841839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 679/1358] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 17 07:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:19:57.853907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627343b-8b1a-404f-8075-9eec54e6b838 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:57.854226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627343b-8b1a-404f-8075-9eec54e6b838 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:57.854783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627343b-8b1a-404f-8075-9eec54e6b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:57.936388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e627343b-8b1a-404f-8075-9eec54e6b838 None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:19:57.937569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e627343b-8b1a-404f-8075-9eec54e6b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:58.001479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:58.087800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 680/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 17 07:19:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:19:58.095906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:19:58.097440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:58.248380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d8bb6-149e-45f0-8d2c-67a089367a5c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:19:58.325071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:19:58.371298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:19:58.371908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:19:58.372186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:19:58.372449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:19:58.374073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:19:58.463565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:19:58.465264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecade1-67e2-4d83-87e8-2fbd9224b8a5 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:19:58.482992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 680/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:20:00.586607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:00.587130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:00.587130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:00.588646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 681/1361] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:00.593880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3606-fafa-42b1-b050-bc0172815ff0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:00.594334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3606-fafa-42b1-b050-bc0172815ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:00.594456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed3606-fafa-42b1-b050-bc0172815ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:00.664073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b1ed3606-fafa-42b1-b050-bc0172815ff0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:00.665438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b1ed3606-fafa-42b1-b050-bc0172815ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:00.704365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:00.767407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 681/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:01.062252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:01.062252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:01.241735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7d9a5-9a77-427f-91a4-5afcd2b1a53d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:01.253452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:01.380915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:01.381539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:01.382210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:01.382625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:01.384731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:01.492158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:01.493927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5ef2-7707-4acf-9e53-09d4b0150c4b service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:01.516454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 682/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:03.715146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c745b2-58c4-4257-b1db-da23292276da None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:03.715686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c745b2-58c4-4257-b1db-da23292276da None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:03.715686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c745b2-58c4-4257-b1db-da23292276da None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:03.717040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 682/1364] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:03.722471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757612c-4468-4230-90dd-be5842412bb1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:03.722888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757612c-4468-4230-90dd-be5842412bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:03.723067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757612c-4468-4230-90dd-be5842412bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:03.740524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:03.795550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3757612c-4468-4230-90dd-be5842412bb1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:03.796760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3757612c-4468-4230-90dd-be5842412bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:03.906504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 683/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:04.200230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:04.202613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:04.202904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:04.204282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 683/1366] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 17 07:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:04.212198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b268e6-f0b5-444b-a6ae-21006d7114ed None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:04.212717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b268e6-f0b5-444b-a6ae-21006d7114ed None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:04.212996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b268e6-f0b5-444b-a6ae-21006d7114ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:04.293512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e4b268e6-f0b5-444b-a6ae-21006d7114ed None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:04.294784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4b268e6-f0b5-444b-a6ae-21006d7114ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:04.331820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:04.429896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 684/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 17 07:20:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:20:04.437796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:04.439337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:04.594736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e83b-d2e4-4d05-b194-0752285ca941 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:04.618836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:04.718611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:04.719315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:04.719570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:04.719757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:04.721370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:04.814529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:04.816174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23dff-1009-48c4-9c7b-f37b418c61af service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:04.838570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 684/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:05.451479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3a2-0c58-4532-8b24-ebe224b0ed96 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:05.451994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3a2-0c58-4532-8b24-ebe224b0ed96 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:05.451994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3a2-0c58-4532-8b24-ebe224b0ed96 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:05.453585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 685/1369] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:05.459206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5629-8c1e-4148-b34c-7f5a4b83afa8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:05.459488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5629-8c1e-4148-b34c-7f5a4b83afa8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:05.459755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e5629-8c1e-4148-b34c-7f5a4b83afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:05.495669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:05.532701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bf3e5629-8c1e-4148-b34c-7f5a4b83afa8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:05.533914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bf3e5629-8c1e-4148-b34c-7f5a4b83afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:05.635190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 685/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:06.217201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:06.217487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:06.217760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:06.221999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 686/1371] 10.222.0.45 () {54 vars in 964 bytes} [Wed Aug 17 07:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:06.226380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812224-e047-45c2-9ffb-f3444f003b6d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:06.226812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812224-e047-45c2-9ffb-f3444f003b6d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:06.226976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3812224-e047-45c2-9ffb-f3444f003b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:06.309068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a3812224-e047-45c2-9ffb-f3444f003b6d None None] MFA Rules not processed for user `0db8a7774fb34badb9da9e2385ef89f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:06.310325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a3812224-e047-45c2-9ffb-f3444f003b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:06.358974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:06.393705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 686/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Aug 17 07:20:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:06.402233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:06.403773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:06.515787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f004-b6c9-4306-a4b1-64db6eb87e9b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:06.561451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:06.611495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:06.612432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:06.612749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:06.613048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:06.614829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:06.735304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:06.737069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efe3f-a0a0-4fe0-99a1-3c6a4e2d4a65 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:06.758405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 687/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:06.830242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:06.830536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:06.830816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:06.832175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 687/1374] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:06.838352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c7374-dc4b-4979-9269-1f5ed7bd5c7d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:06.838688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c7374-dc4b-4979-9269-1f5ed7bd5c7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:06.839206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c7374-dc4b-4979-9269-1f5ed7bd5c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:06.913391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-274c7374-dc4b-4979-9269-1f5ed7bd5c7d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:06.914646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-274c7374-dc4b-4979-9269-1f5ed7bd5c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:06.943591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:07.021478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 688/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:07.308255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:07.309799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:07.458247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d941c-0ac0-4b55-a70f-670b608fa84b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:07.513211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:07.582114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:07.582654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:07.582928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:07.583195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:07.584776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:07.673738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:07.675379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0bf0-1e52-4cd9-af02-ddc6add4ba6e service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:07.693673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 688/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:09.615176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:09.615659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:09.615783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:09.617113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 689/1377] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:09.622392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595239-551d-418e-b9a7-db8c2f05eab6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:09.622825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595239-551d-418e-b9a7-db8c2f05eab6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:09.622945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595239-551d-418e-b9a7-db8c2f05eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:09.687639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ce595239-551d-418e-b9a7-db8c2f05eab6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:09.688845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ce595239-551d-418e-b9a7-db8c2f05eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:09.696074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:09.798447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 689/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:10.088468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:10.090046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:10.268201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee4cab-729f-498a-bd13-f42fb807c43e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:10.279364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:10.421793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:10.422506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:10.422841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:10.423173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:10.424823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:10.521302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:10.522880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7ad11-f851-4070-9a82-29bd9dc64d14 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:10.541934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 690/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:12.474352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:12.474872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:12.474991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:12.476258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 690/1380] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:12.481444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ef1d-c77e-4802-82ee-01224f7d4bb1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:12.481863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ef1d-c77e-4802-82ee-01224f7d4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:12.482070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ef1d-c77e-4802-82ee-01224f7d4bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:12.493742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:12.552421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9234ef1d-c77e-4802-82ee-01224f7d4bb1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:12.553763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9234ef1d-c77e-4802-82ee-01224f7d4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:12.673910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 691/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:12.962640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:12.964473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:13.123611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:13.136313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedcbff-3ed4-438a-9845-33d604f40eea None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:13.257012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:13.257619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:13.257893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:13.258184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:13.259775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:13.360028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:13.362320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4284d-db83-47dc-b056-e45294ba9610 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:13.376379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:13.389841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 691/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:15.329276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:15.329839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:15.329839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:15.331230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 692/1383] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:15.337771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f7-92f3-44ae-aca8-844a6c5c116d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:15.338236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f7-92f3-44ae-aca8-844a6c5c116d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:15.338552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a2f7-92f3-44ae-aca8-844a6c5c116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:15.418658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c6c9a2f7-92f3-44ae-aca8-844a6c5c116d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:15.419902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c6c9a2f7-92f3-44ae-aca8-844a6c5c116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:15.540031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 692/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:15.825723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:15.827367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:15.917470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:15.987464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c7c26-b647-4196-8be7-8737a115c1d7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:16.105994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:16.106568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:16.106853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:16.107121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:16.108787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:16.169058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:16.215228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:16.217282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39c680-4a82-4b84-aa22-e269f0452c34 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:16.238295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 693/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:18.169580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:18.170129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:18.170254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:18.171622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 693/1386] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:18.178008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411379ac-7eae-4b2a-a5da-325c9be5f256 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:18.178431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411379ac-7eae-4b2a-a5da-325c9be5f256 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:18.178562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411379ac-7eae-4b2a-a5da-325c9be5f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:18.251316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-411379ac-7eae-4b2a-a5da-325c9be5f256 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:18.252859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-411379ac-7eae-4b2a-a5da-325c9be5f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:18.373933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 694/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:18.670814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:18.672498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:18.759931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:18.833440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d47ff-b720-4076-863a-d7c12f8ac70e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:18.958745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:18.959386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:18.959673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:18.959942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:18.961627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:19.004793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:19.070778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:19.072893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d226283-b380-4ac2-ba97-910a622715df service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:19.095362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 694/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:21.055827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:21.055827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:21.056486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:21.057611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 695/1389] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:21.062689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9032d-23b5-41d6-adcd-a568ed5b627f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:21.063117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9032d-23b5-41d6-adcd-a568ed5b627f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:21.063219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9032d-23b5-41d6-adcd-a568ed5b627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:21.128203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c5d9032d-23b5-41d6-adcd-a568ed5b627f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:21.129938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c5d9032d-23b5-41d6-adcd-a568ed5b627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:21.224170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 695/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:21.518621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:21.520705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:21.551762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:21.667939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df2c77-c214-4831-8975-815753a0d0b6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:21.733051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2b20-bd82-4904-b092-010da777e029 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:21.733354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2b20-bd82-4904-b092-010da777e029 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:21.733615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f2b20-bd82-4904-b092-010da777e029 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:21.735025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 696/1391] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:20:21.740268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f52b1c-4dde-465a-a43e-66478ba67ed5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:21.740550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f52b1c-4dde-465a-a43e-66478ba67ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:21.740816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f52b1c-4dde-465a-a43e-66478ba67ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:21.756475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:21.768512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:21.787228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:21.787838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:21.788112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:21.788384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:21.790036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:21.810071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b7f52b1c-4dde-465a-a43e-66478ba67ed5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:21.811285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b7f52b1c-4dde-465a-a43e-66478ba67ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:21.882725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:21.884343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bbe9a-e7de-4ff3-8058-432f0c8eb6a7 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:21.902857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 696/1392] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:21.909551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 697/1393] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:20:22.209261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:22.209742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:22.209838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:22.211175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 697/1394] 10.222.0.45 () {54 vars in 967 bytes} [Wed Aug 17 07:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:22.216213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb874855-e4e3-4be7-abb5-47c5592c6a6f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:22.216661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb874855-e4e3-4be7-abb5-47c5592c6a6f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:22.216852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb874855-e4e3-4be7-abb5-47c5592c6a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:22.291873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-eb874855-e4e3-4be7-abb5-47c5592c6a6f None None] MFA Rules not processed for user `1660172c4c324dfab2365443884f6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:22.293063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eb874855-e4e3-4be7-abb5-47c5592c6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:22.329499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:22.376491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 698/1395] 10.222.0.45 () {58 vars in 1064 bytes} [Wed Aug 17 07:20:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:22.384769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:22.386301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:22.487897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d3d81-4b43-4fcf-96ec-e5d54c83c68e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:22.501268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:22.562100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:22.562713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:22.562988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:22.563388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:22.564992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:22.673433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:22.674917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff3e3-f7c5-4034-8c59-954dc1076b3e service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:22.694940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 698/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:23.434261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188472ef-9aeb-4c9d-922e-20fd09b939d1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.434722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188472ef-9aeb-4c9d-922e-20fd09b939d1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.434820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188472ef-9aeb-4c9d-922e-20fd09b939d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.501335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-188472ef-9aeb-4c9d-922e-20fd09b939d1 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:23.502568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-188472ef-9aeb-4c9d-922e-20fd09b939d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:23.588986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 699/1397] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:20:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:23.633567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636832-2acb-465c-b2df-9b674035f443 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.634061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636832-2acb-465c-b2df-9b674035f443 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.634155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1636832-2acb-465c-b2df-9b674035f443 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.635635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 699/1398] 10.222.0.45 () {54 vars in 943 bytes} [Wed Aug 17 07:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:23.642170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.642312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.642684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.702493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:23.720953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] MFA Rules not processed for user `89eb038259df4fbab0b03d2157e3d55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:23.722192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:23.819358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3498e8-f341-4551-885c-ec9055773184 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.819635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3498e8-f341-4551-885c-ec9055773184 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.819902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3498e8-f341-4551-885c-ec9055773184 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.821429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 700/1399] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:20:23.826445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.826721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.826986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.833101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 700/1400] 10.222.0.45 () {58 vars in 1040 bytes} [Wed Aug 17 07:20:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:23.842531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:23.851972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751a6ea-dcf4-4742-92bf-bfc2c3513309 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:23.879973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:23.893531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:23.895033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:23.952022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:23.957586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:23.958365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:23.958643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:23.958912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:23.960550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:23.997086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 701/1401] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:20:24.044615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:24.046232 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d3b55-64ab-4243-a578-4479d44bed43 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:24.054884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 701/1402] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 07:20:24.292275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:24.293532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:24.419122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b83a6-73b5-44bd-b297-982f2a5c48d5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:24.432851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:24.549655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:24.550316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:24.550605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:24.550879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:24.552523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:24.651883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:24.653363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012beff6-4522-4a55-8f8c-2f284ee02569 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:24.674291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 702/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:26.647769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:26.648344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:26.648344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:26.649569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 702/1404] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:26.654818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb252ba-e6d9-45be-99f2-4dd008760e27 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:26.655239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb252ba-e6d9-45be-99f2-4dd008760e27 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:26.655335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb252ba-e6d9-45be-99f2-4dd008760e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:26.676872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:26.730758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fcb252ba-e6d9-45be-99f2-4dd008760e27 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:26.732060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fcb252ba-e6d9-45be-99f2-4dd008760e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:26.841219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 703/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:27.131220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:27.132735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:27.276569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:27.290526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3194e4-85d9-4af3-9829-3e90d5443ea4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:27.417237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:27.418154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:27.418559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:27.418831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:27.420419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:27.522446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:27.524034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb98bf5-72b5-4b49-962c-79490938513c service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:27.537933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:27.547417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 703/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:29.476931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:29.477482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:29.477482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:29.478994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 704/1407] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:29.484033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09a8d-bbd0-472f-8651-15dee4910685 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:29.484498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09a8d-bbd0-472f-8651-15dee4910685 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:29.484603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce09a8d-bbd0-472f-8651-15dee4910685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:29.558405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8ce09a8d-bbd0-472f-8651-15dee4910685 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:29.559556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8ce09a8d-bbd0-472f-8651-15dee4910685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:29.671710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 704/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:29.978905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:29.980453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:30.081481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:30.147425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7c295-38b9-411b-9d0b-574cc51e607e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:30.304942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:30.305652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:30.306080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:30.306468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:30.308278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:30.408454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:30.443678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:30.445443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75eb77-ac54-4d4c-8924-a4d56afd9030 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:30.464106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 705/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:39.666119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=67 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:40.461334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=20 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:46.187988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a63a-ef64-40a3-b955-5920ec64d22d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:46.188551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a63a-ef64-40a3-b955-5920ec64d22d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:46.188551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84a63a-ef64-40a3-b955-5920ec64d22d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:46.189891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 705/1410] 10.222.0.45 () {54 vars in 918 bytes} [Wed Aug 17 07:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:46.195682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232fd3-3d44-4fbc-baf9-811697e2aaf4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:46.196106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232fd3-3d44-4fbc-baf9-811697e2aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:46.196213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e232fd3-3d44-4fbc-baf9-811697e2aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:46.271287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2e232fd3-3d44-4fbc-baf9-811697e2aaf4 None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:46.272400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2e232fd3-3d44-4fbc-baf9-811697e2aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:46.375524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 706/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 17 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:46.390405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29f5c-768c-4188-9b9c-ce27e9711a75 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:46.390685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29f5c-768c-4188-9b9c-ce27e9711a75 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:46.390977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f29f5c-768c-4188-9b9c-ce27e9711a75 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:46.392327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 706/1412] 10.222.0.45 () {54 vars in 918 bytes} [Wed Aug 17 07:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:46.396987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be15c-d77d-47a9-ad8c-04a15610273f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:46.397273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be15c-d77d-47a9-ad8c-04a15610273f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:46.397578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081be15c-d77d-47a9-ad8c-04a15610273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:46.469507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:46.472387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-081be15c-d77d-47a9-ad8c-04a15610273f None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:46.474223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-081be15c-d77d-47a9-ad8c-04a15610273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:46.587178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 707/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 17 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:20:48.956805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:48.957850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:48.958101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:48.959498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:48.964593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0af3-ec96-4177-a906-e90ee25fdb8f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:48.965012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0af3-ec96-4177-a906-e90ee25fdb8f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:48.965115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0af3-ec96-4177-a906-e90ee25fdb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:49.030365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-180c0af3-ec96-4177-a906-e90ee25fdb8f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:49.031550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-180c0af3-ec96-4177-a906-e90ee25fdb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:49.086692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:49.127930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:49.415337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:49.417030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:49.559781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30845bb-7d5f-4c9b-9480-00d00e5569a5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:49.630640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:49.670305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:49.670906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:49.671176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:49.671441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:49.673030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:49.759950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:49.761535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec813c49-7c00-40b0-af66-d66c573f0d95 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:49.780366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 708/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:50.662965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:50.663482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:50.663482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:50.664769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:50.669711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d3b-db55-4d44-8da3-de66588cfd12 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:50.670142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d3b-db55-4d44-8da3-de66588cfd12 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:50.670290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e4d3b-db55-4d44-8da3-de66588cfd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:50.744908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c07e4d3b-db55-4d44-8da3-de66588cfd12 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:50.746138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c07e4d3b-db55-4d44-8da3-de66588cfd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:50.772742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:50.842057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:50.992263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:50.993780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:51.251191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a3c2b-0fe6-47e8-b1e0-7e29d9ef642c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:51.291485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:51.363843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:51.364448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:51.364721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:51.364988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:51.366615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:51.452536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:51.454217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a059c-0b1a-4147-b329-92ed42c11a82 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:51.472777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 710/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:52.348226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:52.348727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:52.348727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:52.350238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:52.355083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963897-52ff-4b90-ad48-40a74f61a84e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:52.355480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963897-52ff-4b90-ad48-40a74f61a84e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:52.355625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72963897-52ff-4b90-ad48-40a74f61a84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:52.410797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:52.432585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-72963897-52ff-4b90-ad48-40a74f61a84e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:52.433792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-72963897-52ff-4b90-ad48-40a74f61a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:52.528253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:52.680072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:52.681525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:52.823221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e92827-8931-4fc3-8f26-258cbc779b51 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:52.835345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:52.933643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:52.934191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:52.934470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:52.934739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:52.936314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:53.023441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:53.025027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d11ca3-b66a-4119-bb0d-1837717de582 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:53.043095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 711/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:53.899607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:53.900173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:53.900173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:53.902150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:53.907058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a832ea-e7be-4c90-9168-a16e514c168d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:53.907501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a832ea-e7be-4c90-9168-a16e514c168d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:53.907607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a832ea-e7be-4c90-9168-a16e514c168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:53.927005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:53.982455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-74a832ea-e7be-4c90-9168-a16e514c168d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:53.983641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-74a832ea-e7be-4c90-9168-a16e514c168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:54.078490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:54.229984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:54.231508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:54.340935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:54.377198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f74d0-1535-4163-a255-bced15f020d7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:54.486193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:54.486719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:54.486994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:54.487257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:54.489621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:54.562484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:54.576585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:54.578206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f8025-c8e0-481a-b589-0a4a9ad8c85f service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:54.595647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 713/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:55.444395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:55.444929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:55.444929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:55.446334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:55.451100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4764b-4355-46ca-93df-0158ccb9f8d3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:55.451489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4764b-4355-46ca-93df-0158ccb9f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:55.451638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4764b-4355-46ca-93df-0158ccb9f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:55.525141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b0d4764b-4355-46ca-93df-0158ccb9f8d3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:55.526369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b0d4764b-4355-46ca-93df-0158ccb9f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:55.622151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:55.771817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:55.773343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:55.855820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:55.919997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926a9c-ee95-4109-87c3-27798c45ad26 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:56.029909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:56.030579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:56.030856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:56.031125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:56.032716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:56.079201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:56.120084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:56.121667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e95d9e-b0c5-43cb-9846-9b55dd6c2afc service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:56.139643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 714/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:56.929477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:56.930119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:56.930119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:56.931423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:56.936375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f5f5-f571-4cb1-9af0-a3078f1e2686 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:56.936795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f5f5-f571-4cb1-9af0-a3078f1e2686 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:56.936907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f5f5-f571-4cb1-9af0-a3078f1e2686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:57.010433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0741f5f5-f571-4cb1-9af0-a3078f1e2686 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:57.011620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0741f5f5-f571-4cb1-9af0-a3078f1e2686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:57.106488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:57.254944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:57.256437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:57.303768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:57.402397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d760e14-9c9e-4981-855e-dd10230207e5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:57.511485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:57.512015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:57.512286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:57.512553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:57.514174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:57.521410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:57.602605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:57.604186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c4900-1786-4b35-b31f-bf47979e9588 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:57.621979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 716/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:58.423426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:58.423964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:58.423964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:58.425902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:58.430748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01e56-a816-4a0a-a0cc-0f0b99cb8a48 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:58.431179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01e56-a816-4a0a-a0cc-0f0b99cb8a48 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:58.431287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e01e56-a816-4a0a-a0cc-0f0b99cb8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:58.506475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-84e01e56-a816-4a0a-a0cc-0f0b99cb8a48 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:20:58.507664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-84e01e56-a816-4a0a-a0cc-0f0b99cb8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:58.575226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:58.604561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:20:58.755480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:20:58.756983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:58.774893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:58.901973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf7721-0923-4ccb-8195-5aa0b3928a7d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:20:58.987020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:20:59.012955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:20:59.013650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:59.013930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:59.014230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:59.015812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:20:59.103938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:20:59.105528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2c04e-3bb3-4c2a-a596-cd3fe4110616 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:20:59.123297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 717/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:20:59.929481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:59.930064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:59.930064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:20:59.931430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:20:59.936212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5a9c-4af6-427a-82b5-aa797598a369 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:20:59.936632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5a9c-4af6-427a-82b5-aa797598a369 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:20:59.936786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5a9c-4af6-427a-82b5-aa797598a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:00.011715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d3ef5a9c-4af6-427a-82b5-aa797598a369 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:00.012945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d3ef5a9c-4af6-427a-82b5-aa797598a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:00.054301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:00.108802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:00.260166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:00.261690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:00.404802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfbb47-dc90-47d1-a979-4992b2265785 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:00.458053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:00.517133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:00.517705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:00.518000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:00.518270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:00.520391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:00.607322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:00.608886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f419c-72ba-4d38-ac0f-570c31e74a06 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:00.626681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 719/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:01.421505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:01.422053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:01.422053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:01.423402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:01.428917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ee20-63a9-4abf-9a0e-91a02bf42d58 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:01.429328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ee20-63a9-4abf-9a0e-91a02bf42d58 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:01.429463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899ee20-63a9-4abf-9a0e-91a02bf42d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:01.504195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e899ee20-63a9-4abf-9a0e-91a02bf42d58 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:01.505390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e899ee20-63a9-4abf-9a0e-91a02bf42d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:01.507436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:01.600182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:01.750179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:01.751683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:01.894519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d285203-f0b1-4c27-bbc3-72c502f135d3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:01.920933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:02.006641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:02.007236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:02.007507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:02.007773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:02.009348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:02.096543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:02.098743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5658af-aa90-49c5-aa29-1bc559276788 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:02.116249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 720/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:03.915468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:03.915975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:03.915975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:03.917264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:03.922475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ecd47-fc1a-4758-bf46-94cb27eda4c0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:03.922871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ecd47-fc1a-4758-bf46-94cb27eda4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:03.923011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ecd47-fc1a-4758-bf46-94cb27eda4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:03.963709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:03.989571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-696ecd47-fc1a-4758-bf46-94cb27eda4c0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:03.990796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-696ecd47-fc1a-4758-bf46-94cb27eda4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:04.085462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:04.374243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:04.375781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:04.477288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fba5-87b4-4c6f-95ed-dff50493a1a1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:04.508697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:04.549762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:04.550408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:04.550681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:04.550947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:04.552543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:04.659741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:04.661203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a879e5-3d5f-4a9a-9b0a-9f3242481945 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:04.679194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 722/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:06.704864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:06.705407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:06.705407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:06.707367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:21:06.712637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fa19-161e-43a4-933c-c67976649b02 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:06.713066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fa19-161e-43a4-933c-c67976649b02 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:06.713185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844fa19-161e-43a4-933c-c67976649b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:06.776993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b844fa19-161e-43a4-933c-c67976649b02 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:06.778207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b844fa19-161e-43a4-933c-c67976649b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:06.790860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:06.874782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:07.161497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:07.163078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:07.266760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506574a6-d46d-4a65-97b0-385fa31c91bc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:07.278705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:07.339769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:07.340368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:07.340640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:07.340905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:07.342509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:07.450862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:07.452295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cad12c-fae8-4805-a13d-54a7d4c99436 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:07.470109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 723/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:09.726050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:09.726588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:09.726588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:09.727913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:21:09.733003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b917-4598-49d0-8618-7f71fce834e5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:09.733420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b917-4598-49d0-8618-7f71fce834e5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:09.733554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4b917-4598-49d0-8618-7f71fce834e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:09.781925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:09.799458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-97c4b917-4598-49d0-8618-7f71fce834e5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:09.800695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-97c4b917-4598-49d0-8618-7f71fce834e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:09.899353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:10.190107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:10.192193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:10.292788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8cd1-e7c7-4a1d-968e-e1e6e8d5fb5e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:10.332128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:10.366325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:10.366928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:10.367200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:10.367464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:10.369056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:10.474857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:10.476282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475872b6-60f0-4a74-8c2e-ed6bf91d7920 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:10.495249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 725/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:12.507334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:12.507860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:12.507860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:12.509253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:12.514572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa550f-cf8f-4512-9590-a5ba1a83c169 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:12.514967 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa550f-cf8f-4512-9590-a5ba1a83c169 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:12.515120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa550f-cf8f-4512-9590-a5ba1a83c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:12.579952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2afa550f-cf8f-4512-9590-a5ba1a83c169 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:12.581670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2afa550f-cf8f-4512-9590-a5ba1a83c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:12.604181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:12.680354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:12.962288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:12.963855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:13.067072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118ebc-cf52-49a3-94ec-b336dcb95fa2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:13.086864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:13.140240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:13.140843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:13.141122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:13.141394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:13.143028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:13.250827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:13.252315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6e562-9132-4381-8571-176296b8572d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:13.270631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 726/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:15.277084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:15.277661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:15.277661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:15.279054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:15.284167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ce23-ead7-4ccf-a13d-7fb09b9fa7d1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:15.284647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ce23-ead7-4ccf-a13d-7fb09b9fa7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:15.284754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470ce23-ead7-4ccf-a13d-7fb09b9fa7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:15.346926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:15.349881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3470ce23-ead7-4ccf-a13d-7fb09b9fa7d1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:15.351707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3470ce23-ead7-4ccf-a13d-7fb09b9fa7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:15.448686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:15.734781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:15.736307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:15.837239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160e97-a3cf-469f-8d19-4845e9f2d2a6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:15.885094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:15.908913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:15.910069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:15.910340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:15.910602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:15.912166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:16.024906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:16.026422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de517d1-14c9-49ef-988b-2e8967476998 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:16.045031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 728/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:17.979504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:17.980038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:17.980038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:17.981407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:17.986653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecee4e-8797-419e-9cdc-c4b2d2ad7491 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:17.987072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecee4e-8797-419e-9cdc-c4b2d2ad7491 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:17.987195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecee4e-8797-419e-9cdc-c4b2d2ad7491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:18.055010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-98ecee4e-8797-419e-9cdc-c4b2d2ad7491 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:18.056223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-98ecee4e-8797-419e-9cdc-c4b2d2ad7491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:18.084292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:18.150507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:18.434571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:18.436101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:18.538789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dd009-d6fd-4583-9934-9bda4608f99b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:18.566203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:18.611589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:18.612116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:18.612398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:18.612669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:18.614575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:18.722074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:18.723491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fadfba-35cb-4cea-bc9d-59fcd5ec7d90 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:18.741041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 729/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:20.678989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:20.679505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:20.679604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:20.680943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:20.686231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ded5-a46a-451b-ac88-86ff4a3512ef None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:20.686611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ded5-a46a-451b-ac88-86ff4a3512ef None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:20.686781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ded5-a46a-451b-ac88-86ff4a3512ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:20.751810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8e49ded5-a46a-451b-ac88-86ff4a3512ef None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:20.753608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8e49ded5-a46a-451b-ac88-86ff4a3512ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:20.761781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:20.849495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:21.129449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:21.131039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:21.233852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbac705-2121-4082-a5c9-4328f3692e92 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:21.288398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:21.306117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:21.306713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:21.306987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:21.307251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:21.308837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:21.416216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:21.417584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de515c-065d-4106-a664-62b1039b86d9 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:21.435624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 731/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:23.360718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:23.361126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:23.361245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:23.362688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:23.368089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b190-537d-4c64-b80f-6bb48b2ff393 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:23.368518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b190-537d-4c64-b80f-6bb48b2ff393 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:23.368619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b190-537d-4c64-b80f-6bb48b2ff393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:23.432981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f1f4b190-537d-4c64-b80f-6bb48b2ff393 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:23.434197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1f4b190-537d-4c64-b80f-6bb48b2ff393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:23.471658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:23.528693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:23.808727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:23.810289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:23.916401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e339531-540b-4d4f-a3c2-bf745c49beb4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:23.953198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:23.989220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:23.989815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:23.990118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:23.990389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:23.991964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:24.097091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:24.099010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbf818-9595-44c9-9ba9-19e182779b9c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:24.117213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 732/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:26.003227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:26.004370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:26.004370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:26.005764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:26.010978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17cb7-8665-4519-acf8-da9977df520e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:26.011363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17cb7-8665-4519-acf8-da9977df520e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:26.011526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17cb7-8665-4519-acf8-da9977df520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:26.082132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f0c17cb7-8665-4519-acf8-da9977df520e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:26.083329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f0c17cb7-8665-4519-acf8-da9977df520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:26.101458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:26.178685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:26.453640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:26.455257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:26.558623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886932b-a24e-4a19-885d-a0347153dd55 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:26.626873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:26.633818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:26.634468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:26.634730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:26.634997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:26.636599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:26.743786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:26.745213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c590b-f7a3-4944-bb66-3e71776c8413 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:26.763224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 734/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:28.664051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:28.664575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:28.664575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:28.665863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:28.671267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef949-a703-4e08-9e0f-0c3e157d91d3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:28.671690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef949-a703-4e08-9e0f-0c3e157d91d3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:28.671832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef949-a703-4e08-9e0f-0c3e157d91d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:28.735567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-befef949-a703-4e08-9e0f-0c3e157d91d3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:28.736748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-befef949-a703-4e08-9e0f-0c3e157d91d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:28.783776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:28.832572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:29.110844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:29.112494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:29.213842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6846b0-b7c8-4f2d-b5f4-7c31b6cff67f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:29.260956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:29.288044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:29.288814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:29.289087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:29.289484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:29.291160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:29.402978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:29.404321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbc7e-d307-4cc1-a941-f360f1931d2d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:29.422324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 735/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:38.830807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=22 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:39.420072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=66 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:48.693536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38e94-b4ce-4340-b031-0b6f02ee2ef2 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:48.694094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38e94-b4ce-4340-b031-0b6f02ee2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:48.694195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38e94-b4ce-4340-b031-0b6f02ee2ef2 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:48.695488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 736/1471] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:48.700668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2d55-40ab-4173-8468-455495825398 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:48.701108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2d55-40ab-4173-8468-455495825398 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:48.701215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2d55-40ab-4173-8468-455495825398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:48.765403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-370b2d55-40ab-4173-8468-455495825398 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:48.766599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-370b2d55-40ab-4173-8468-455495825398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:48.861434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 736/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:49.153653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:49.153933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:49.154247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:49.155606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 737/1473] 10.222.0.45 () {54 vars in 967 bytes} [Wed Aug 17 07:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:49.160446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395fd6-1844-49b0-9792-2508be01e057 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:49.160735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395fd6-1844-49b0-9792-2508be01e057 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:49.161038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69395fd6-1844-49b0-9792-2508be01e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:49.235508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-69395fd6-1844-49b0-9792-2508be01e057 None None] MFA Rules not processed for user `1660172c4c324dfab2365443884f6784`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:49.236724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69395fd6-1844-49b0-9792-2508be01e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:49.258451 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:49.323674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 737/1474] 10.222.0.45 () {58 vars in 1064 bytes} [Wed Aug 17 07:21:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:49.331444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:49.332953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:49.436228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fd1c2-cce5-4912-bf99-cfbb1b788d67 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:49.506939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:49.507527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:49.507795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:49.508056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:49.509625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:49.561667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:49.616682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:49.618813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de58a4d-f6eb-4d8a-88a9-8dc682ef784f service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:49.638240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 738/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:51.609168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:51.609694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:51.609694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:51.611002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 738/1476] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:51.616309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a3f7-a6ed-4f36-ad93-8181af1fbe56 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:51.616730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a3f7-a6ed-4f36-ad93-8181af1fbe56 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:51.616843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655a3f7-a6ed-4f36-ad93-8181af1fbe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:51.680305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c655a3f7-a6ed-4f36-ad93-8181af1fbe56 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:51.681499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c655a3f7-a6ed-4f36-ad93-8181af1fbe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:51.775108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 739/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:52.051635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:52.053153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:52.176243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545e1f-7996-4298-bd7b-95095ee399bc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:52.224383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:52.269087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:52.269682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:52.269954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:52.270241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:52.270915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:52.272605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:21:52.272605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:21:52.272605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:21:52.273739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48085637-decd-4427-be73-2b48a033e6bf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:52.291946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 739/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Aug 17 07:21:52 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:21:54.207747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:54.208326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:54.208326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:54.209601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 740/1479] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:54.214874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a46b-b911-458f-9314-ed5be7482c00 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:54.215297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a46b-b911-458f-9314-ed5be7482c00 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:54.215411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a46b-b911-458f-9314-ed5be7482c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:54.282084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c260a46b-b911-458f-9314-ed5be7482c00 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:54.283219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c260a46b-b911-458f-9314-ed5be7482c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:54.379261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 740/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:54.667740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:54.669284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:54.679623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:54.810880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b892e9-2c56-4123-b260-0fa9d241a477 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:54.889544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:54.921895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:54.922457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:54.922727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:54.922991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:54.924565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:55.011647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:55.013233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd5f28-0ebf-4cc0-9908-f1a5d783e4e6 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:55.030904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 741/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:57.101563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:57.102183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:57.102183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:57.103486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 741/1482] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:21:57.108677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0d86-577a-465b-893a-a0b84c5bac31 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:57.109064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0d86-577a-465b-893a-a0b84c5bac31 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:57.109221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0d86-577a-465b-893a-a0b84c5bac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:57.174016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-af7c0d86-577a-465b-893a-a0b84c5bac31 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:57.175817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-af7c0d86-577a-465b-893a-a0b84c5bac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:57.220986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:57.274163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 742/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:21:57.560678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:21:57.562255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:57.585947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:57.666154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa24f8-67c3-4d6f-8351-3e7ebdc97cc4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:21:57.736565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:21:57.737159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:57.737457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:57.737738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:57.739584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:57.811132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:21:57.847911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:21:57.849336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0740f97-7973-44d5-974e-3617288480ea service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:21:57.867632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 742/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:21:59.798877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:59.799433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:59.799433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:59.801327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 743/1485] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:21:59.806726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe89e-2127-4fbc-a530-35f8e6a6f006 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:21:59.807135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe89e-2127-4fbc-a530-35f8e6a6f006 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:21:59.807277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfe89e-2127-4fbc-a530-35f8e6a6f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:21:59.873872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1ccfe89e-2127-4fbc-a530-35f8e6a6f006 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:21:59.875100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1ccfe89e-2127-4fbc-a530-35f8e6a6f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:21:59.969219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 743/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:22:00.273658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:22:00.275271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:00.376619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbba76-6073-480b-98c7-ec669464ee68 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:22:00.447162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:00.448995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:22:00.449607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:00.450100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:00.450637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:00.452486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:00.560269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:22:00.561639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196cdec-4fba-48d5-bb77-cfa752ed955e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:22:00.579547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 744/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:22:02.693389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:02.693926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:02.693926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:02.695296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 744/1488] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:22:02.700515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aec9b-543d-4d9f-8580-338e624c3fe5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:02.700928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aec9b-543d-4d9f-8580-338e624c3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:02.701083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6aec9b-543d-4d9f-8580-338e624c3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:02.765076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ee6aec9b-543d-4d9f-8580-338e624c3fe5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:22:02.766300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee6aec9b-543d-4d9f-8580-338e624c3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:02.817824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:02.863368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 745/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:22:03.153781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:22:03.155362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:03.191395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:03.258042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10eb2f-8ff7-40e8-85d4-bf12c7880b57 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:22:03.329586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:22:03.330209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:03.330485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:03.330754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:03.332864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:03.412842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:03.441064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:22:03.442531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137deb7-e509-453b-88ec-42a2c1f0365a service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:22:03.460518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 745/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:22:05.552731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:05.553284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:05.553284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:05.554638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 746/1491] 10.222.0.45 () {54 vars in 927 bytes} [Wed Aug 17 07:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:22:05.559752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498746-9044-4b9b-84ba-fe7c6bd03c11 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:05.560223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498746-9044-4b9b-84ba-fe7c6bd03c11 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:05.560341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498746-9044-4b9b-84ba-fe7c6bd03c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:05.625349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-39498746-9044-4b9b-84ba-fe7c6bd03c11 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:22:05.626492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-39498746-9044-4b9b-84ba-fe7c6bd03c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:05.723219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 746/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Wed Aug 17 07:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:22:06.011901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:22:06.013439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:06.117913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e390d2-2548-4748-873c-aba1ee984456 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:22:06.189397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:22:06.190024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:22:06.190302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:22:06.190567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:22:06.192158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:22:06.201035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:06.300695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:22:06.302066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77551c-b4ad-459e-9bcb-b48a0bdc8471 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:22:06.320132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 747/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:22:15.721457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=82 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:22:16.317885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=50 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:23.709026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:23.709592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:23.709592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:23.902914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:23:23.904115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.007868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 747/1494] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:23:24.016314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.016891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.016891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.091512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:23:24.092731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.186283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 748/1495] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:23:24.191424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.192642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.203880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030e3f-6481-4619-ba46-28f890e4ed07 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:24.265084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:24.297735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:24.298856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.299134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.299404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.300040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:23:24.300338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:24.301335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:24.301335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:23:24.301335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:23:24.302249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:24.314373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 748/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:23:24.322607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.331729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bb98-95e4-4d3a-98bd-ef4bde56f7e1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:24.393015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:24.426794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:24.427402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.427678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.427948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.428602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:24.430358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:24.430358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:23:24.430358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:23:24.431557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:24.486509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 749/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:23:24 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:23:24.490949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.492487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.526407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a3b49-ad1c-4495-a224-ffcdd86387f1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:24.618529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:24.619121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.619395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.619663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.620268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:24.621275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:24.621275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:23:24.621275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:23:24.622518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:24.662809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 749/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:23:24 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:23:24.666876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.668369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.730151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff3c92-3f67-428a-a49c-bdeec579c354 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:24.812376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:24.824520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:24.825294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.825632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.825893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.826549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:24.827550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:24.827550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:23:24.827550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:23:24.828421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:24.840402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 750/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:23:24.844428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.846531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:24.857708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eae89f-09b8-4749-8ec5-84bdb894d9f2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:24.882881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:24.953467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:24.954089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:24.954366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:24.954631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:24.955270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:24.956302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:24.956302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:23:24.956302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:23:24.957171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d81a3-7147-4392-be37-b83d9982512f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:24.969110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 750/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:23:24.973788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:24.975329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.008387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d610ac8-be6d-492f-b1dd-c97ee6018b41 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:25.099727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:25.100326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.100572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.100840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] PATH_INFO: `/v3/projects/0a529ae670f0455680fbeec428422d2a/users/6ae44b39cb214acdba5cf1a3455d9bdb/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.122396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a529ae670f0455680fbeec428422d2a, user_id=6ae44b39cb214acdba5cf1a3455d9bdb, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:25.123416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:25.123416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:23:25.123416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:23:25.125347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4d331-f5e5-4ad4-92a0-300986d13c5c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:25.149255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 751/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:23:24 2022] PUT /identity/v3/projects/0a529ae670f0455680fbeec428422d2a/users/6ae44b39cb214acdba5cf1a3455d9bdb/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:23:25.162025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3582-9a19-42fa-9627-b2610dcbc041 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.162336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3582-9a19-42fa-9627-b2610dcbc041 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.162605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a3582-9a19-42fa-9627-b2610dcbc041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.217785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c60a3582-9a19-42fa-9627-b2610dcbc041 None None] MFA Rules not processed for user `6ae44b39cb214acdba5cf1a3455d9bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:23:25.219021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c60a3582-9a19-42fa-9627-b2610dcbc041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.295162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 751/1502] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:23:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:23:25.308289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.308572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.308842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.310380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 752/1503] 10.222.0.45 () {54 vars in 964 bytes} [Wed Aug 17 07:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:23:25.315167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3c99-c14a-4e7f-8ee8-812b292ab08f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.315457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3c99-c14a-4e7f-8ee8-812b292ab08f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.315728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd3c99-c14a-4e7f-8ee8-812b292ab08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.346836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:25.391248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4abd3c99-c14a-4e7f-8ee8-812b292ab08f None None] MFA Rules not processed for user `0db8a7774fb34badb9da9e2385ef89f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:23:25.393076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4abd3c99-c14a-4e7f-8ee8-812b292ab08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.466383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 752/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Aug 17 07:23:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:23:25.474317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:25.475827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.525684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:25.580680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e38d3-eb1d-4b25-bbdb-b8795f96cda7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:25.653955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:25.654534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.654810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.655081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.656701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.753725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:25.755180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:25.758637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:25.773256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 753/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:23:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:23:25.817779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d36c7-958b-4807-8cec-e0e41b2871a8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:25.818092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d36c7-958b-4807-8cec-e0e41b2871a8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:25.818364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d36c7-958b-4807-8cec-e0e41b2871a8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:25.819611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 753/1506] 10.222.0.45 () {52 vars in 830 bytes} [Wed Aug 17 07:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:23:25.823092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:25.824373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:25.920965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0479ea-847d-4c21-9645-68d9fb156b96 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:26.011473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:26.012088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:26.012356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:26.012615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] PATH_INFO: `/v3/users/6ae44b39cb214acdba5cf1a3455d9bdb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:26.024234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae44b39cb214acdba5cf1a3455d9bdb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:26.025239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:26.025239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:23:26.025239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:23:26.026465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:26.035879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:26.093555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae44b39cb214acdba5cf1a3455d9bdb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:26.094135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae44b39cb214acdba5cf1a3455d9bdb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:26.117836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae44b39cb214acdba5cf1a3455d9bdb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:26.126805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae44b39cb214acdba5cf1a3455d9bdb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:26.140717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae44b39cb214acdba5cf1a3455d9bdb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:26.146293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 754/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:23:25 2022] DELETE /identity/v3/users/6ae44b39cb214acdba5cf1a3455d9bdb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:23:26.150655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:26.151126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:26.151234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:26.206843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:23:26.208042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:26.283557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:26.296797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 754/1508] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:23:26.307281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:26.308505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:26.407446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca141d8c-1371-4060-9c0e-eb732a8d1353 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:26.463326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:26.482957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:26.483563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:26.483872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:26.484145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:26.486299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:26.592360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:26.593809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826f97d-90d0-47c1-85f0-5c04e5dac873 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:26.612553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 755/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:23:26.927602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:23:26.928909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:23:26.940130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecd3a5-b96f-472c-9e7e-1d69613b1230 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:23:27.037400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:23:27.037944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:23:27.038244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:23:27.038505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] PATH_INFO: `/v3/projects/0a529ae670f0455680fbeec428422d2a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:23:27.048663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a529ae670f0455680fbeec428422d2a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:23:27.050123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:23:27.050123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:23:27.050123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:23:27.051000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:23:27.106776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a529ae670f0455680fbeec428422d2a', 'request_id': 'req-940d6f17-5551-4631-aa81-404b5aff9b8f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:27.113131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a529ae670f0455680fbeec428422d2a', 'request_id': 'req-940d6f17-5551-4631-aa81-404b5aff9b8f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:27.123211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a529ae670f0455680fbeec428422d2a', 'request_id': 'req-940d6f17-5551-4631-aa81-404b5aff9b8f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:27.151811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] The token cache is being invalidate because project 0a529ae670f0455680fbeec428422d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:23:27.152374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:27.152602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-940d6f17-5551-4631-aa81-404b5aff9b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:23:27.153901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 755/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:23:26 2022] DELETE /identity/v3/projects/0a529ae670f0455680fbeec428422d2a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:23:36.609788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=62 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:23:37.149815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:24:51.364305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:51.364801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:51.364911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:51.366505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:24:51.371310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51f59e-4395-4e0d-8aa3-65937566f005 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:51.371745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51f59e-4395-4e0d-8aa3-65937566f005 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:51.371844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51f59e-4395-4e0d-8aa3-65937566f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:51.451573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6f51f59e-4395-4e0d-8aa3-65937566f005 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:24:51.452778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6f51f59e-4395-4e0d-8aa3-65937566f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:24:51.556676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:24:51.709581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:24:51.711731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:24:51.829663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92910-7877-4dbb-b2a1-57f0438cf32f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:24:51.835179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:24:51.835791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:51.836070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:51.836342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:51.844549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:24:51.846206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f640-6fda-4862-9881-d8146b499610 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:24:51.856057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 757/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:24:52.525281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea8ee-efcb-48d8-8e2b-e97579acbe42 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:52.525862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea8ee-efcb-48d8-8e2b-e97579acbe42 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:52.525862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ea8ee-efcb-48d8-8e2b-e97579acbe42 None None] PATH_INFO: `/v3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:52.527104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 757/1514] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 17 07:24:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:24:52.533822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f7af-9fe5-40b0-9ac8-8bfcd8cda928 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:52.534294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f7af-9fe5-40b0-9ac8-8bfcd8cda928 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:52.534398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f7af-9fe5-40b0-9ac8-8bfcd8cda928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:52.592643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b1e0f7af-9fe5-40b0-9ac8-8bfcd8cda928 None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:24:52.593865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b1e0f7af-9fe5-40b0-9ac8-8bfcd8cda928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:24:52.661347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:24:52.672198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 758/1515] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:24:52.696769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff3e8-5f05-44a4-92bd-2097d4ca7418 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:52.697051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff3e8-5f05-44a4-92bd-2097d4ca7418 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:52.697314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ff3e8-5f05-44a4-92bd-2097d4ca7418 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:52.698990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:24:52.705713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c295-8f12-4c85-a848-b0286cfc16bd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:52.706019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c295-8f12-4c85-a848-b0286cfc16bd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:52.706290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c295-8f12-4c85-a848-b0286cfc16bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:52.724955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bf27c295-8f12-4c85-a848-b0286cfc16bd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:24:52.726163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bf27c295-8f12-4c85-a848-b0286cfc16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:24:52.733869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:24:52.883557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ff3e8-5f05-44a4-92bd-2097d4ca7418 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:24:52.898402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ff3e8-5f05-44a4-92bd-2097d4ca7418 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:24:52.903805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:24:52.904388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:52.904664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:52.904929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:52.912924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:24:52.914532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97161a18-131b-44ea-b088-18f0dc71085c service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:24:52.923741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 759/1518] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:24:56.442660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7cb0a-513a-452e-9223-5a2983444355 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:56.443178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7cb0a-513a-452e-9223-5a2983444355 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:56.443292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7cb0a-513a-452e-9223-5a2983444355 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:56.444661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 760/1519] 10.222.0.45 () {54 vars in 961 bytes} [Wed Aug 17 07:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:24:56.449321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa176-edb8-4fd0-a1ea-fe98a56cbe6a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:56.449810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa176-edb8-4fd0-a1ea-fe98a56cbe6a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:56.449920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa176-edb8-4fd0-a1ea-fe98a56cbe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:56.469070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-343fa176-edb8-4fd0-a1ea-fe98a56cbe6a None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:24:56.470273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-343fa176-edb8-4fd0-a1ea-fe98a56cbe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:24:56.478623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 760/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Aug 17 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:24:56.485760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7cb0a-513a-452e-9223-5a2983444355 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:24:56.499129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7cb0a-513a-452e-9223-5a2983444355 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:24:56.504531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:24:56.505106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:24:56.505381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:24:56.505656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:24:56.513670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:24:56.515296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d701c1-4d0d-4d39-b977-884d2680f7d6 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:24:56.525383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 761/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:24:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:04.138453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8107-5029-4df0-af65-59ca450711f8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:04.138904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8107-5029-4df0-af65-59ca450711f8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:04.139012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8107-5029-4df0-af65-59ca450711f8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:04.140383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:04.145193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9e8f-02eb-4398-a67e-6fdd0901323e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:04.145759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9e8f-02eb-4398-a67e-6fdd0901323e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:04.146074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9e8f-02eb-4398-a67e-6fdd0901323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:04.169271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e65c9e8f-02eb-4398-a67e-6fdd0901323e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:04.170524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e65c9e8f-02eb-4398-a67e-6fdd0901323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:04.179304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:25:04.333988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e8107-5029-4df0-af65-59ca450711f8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:04.348765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e8107-5029-4df0-af65-59ca450711f8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:04.354300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:04.354894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:04.355171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:04.355441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:04.363719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:04.365296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ece3b-b64f-4e2d-8a9b-9d2f1172bdb8 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:04.375145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 762/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:05.187393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c34b-9e66-49a2-8c85-030f7f50df3c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:05.187965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c34b-9e66-49a2-8c85-030f7f50df3c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:05.187965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181c34b-9e66-49a2-8c85-030f7f50df3c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:05.189278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 07:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:05.194568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d97f9-4271-4ec5-a83e-f91c445f5c71 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:05.194965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d97f9-4271-4ec5-a83e-f91c445f5c71 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:05.195121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d97f9-4271-4ec5-a83e-f91c445f5c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:05.214166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ef5d97f9-4271-4ec5-a83e-f91c445f5c71 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:05.215359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef5d97f9-4271-4ec5-a83e-f91c445f5c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:05.223371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 07:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:25:05.374447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c34b-9e66-49a2-8c85-030f7f50df3c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:05.389265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181c34b-9e66-49a2-8c85-030f7f50df3c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:05.394672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:05.395260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:05.395536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:05.395804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:05.403730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:05.405304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869daf8-4b57-42a3-abb1-ae3c04036f52 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:05.415134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 764/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:09.180654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:09.181192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:09.181192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:09.182677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:09.187658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512400-dd07-4bf6-80f0-cc8a6d7636a7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:09.188053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512400-dd07-4bf6-80f0-cc8a6d7636a7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:09.188205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512400-dd07-4bf6-80f0-cc8a6d7636a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:09.206922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ef512400-dd07-4bf6-80f0-cc8a6d7636a7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:09.208111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ef512400-dd07-4bf6-80f0-cc8a6d7636a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:09.216264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:25:09.500675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:09.502494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:09.535558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:25:09.580089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400df2-4f72-4982-9cd6-11215e1ecb42 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:09.584162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:09.584758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:09.585036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:09.585308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:09.594064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:09.595489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82ec6a-62e1-4061-bde2-7e9f53d45007 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:09.605517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 765/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:11.486199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e584b3-4522-430b-90ac-8927f7f265cd None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:11.486804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e584b3-4522-430b-90ac-8927f7f265cd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:11.486804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e584b3-4522-430b-90ac-8927f7f265cd None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:11.488106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:11.493762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942860-83f4-4e2f-a2a8-fad95a348188 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:11.494221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942860-83f4-4e2f-a2a8-fad95a348188 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:11.494336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942860-83f4-4e2f-a2a8-fad95a348188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:11.513822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2c942860-83f4-4e2f-a2a8-fad95a348188 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:11.515026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2c942860-83f4-4e2f-a2a8-fad95a348188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:11.523356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:25:11.805936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e584b3-4522-430b-90ac-8927f7f265cd None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:11.817409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e584b3-4522-430b-90ac-8927f7f265cd None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:11.820944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:11.821537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:11.821814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:11.822138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:11.830830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:11.832303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc11429-f2a9-4586-b6b1-c7dc531fe67d service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:11.841730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 767/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:15.039886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:15.040426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:15.040426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:15.041761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:15.046866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b62-b889-4dc2-858c-6d0213fd57ca None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:15.047294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b62-b889-4dc2-858c-6d0213fd57ca None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:15.047404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b62-b889-4dc2-858c-6d0213fd57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:15.066130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f1036b62-b889-4dc2-858c-6d0213fd57ca None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:15.067304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1036b62-b889-4dc2-858c-6d0213fd57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:15.074995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:25:15.616952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:15.618627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:15.697249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af89b5-d2e7-40de-bb32-e72c2fe1d4bf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:15.700771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:15.701360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:15.701632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:15.701899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:15.710564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:15.711964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f60f-a99d-4428-84d2-018ae69e42e6 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:15.721109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 768/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:17.617088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-9512-461b-92b0-58344431168c None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:17.617614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-9512-461b-92b0-58344431168c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:17.617614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67858ea-9512-461b-92b0-58344431168c None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:17.618983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 07:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:25:17.624002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4bef0-8afe-4d31-97f1-10335c76de39 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:17.624413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4bef0-8afe-4d31-97f1-10335c76de39 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:17.624531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4bef0-8afe-4d31-97f1-10335c76de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:17.643344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c8a4bef0-8afe-4d31-97f1-10335c76de39 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:25:17.644512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c8a4bef0-8afe-4d31-97f1-10335c76de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:17.652182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 07:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:25:18.194673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67858ea-9512-461b-92b0-58344431168c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:25:18.196355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c67858ea-9512-461b-92b0-58344431168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:25:18.209721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67858ea-9512-461b-92b0-58344431168c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:25:18.213206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:25:18.213791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:25:18.214110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:25:18.214383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:25:18.223110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:25:18.224534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3c7e5-896f-410a-b8b1-3be80dd31776 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:25:18.234246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 770/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:25:27.638693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=63 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:25:28.229786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=37 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:40.594525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8204f-6f9d-497f-b013-dbb06b7d0215 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.595186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8204f-6f9d-497f-b013-dbb06b7d0215 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.595186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8204f-6f9d-497f-b013-dbb06b7d0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.619167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b3c8204f-6f9d-497f-b013-dbb06b7d0215 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.620366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b3c8204f-6f9d-497f-b013-dbb06b7d0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.635995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 770/1540] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.645385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d123b8-28ab-4ee6-8ef6-0f72a64f6871 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.646009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d123b8-28ab-4ee6-8ef6-0f72a64f6871 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.646009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d123b8-28ab-4ee6-8ef6-0f72a64f6871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.671203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-18d123b8-28ab-4ee6-8ef6-0f72a64f6871 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.672532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-18d123b8-28ab-4ee6-8ef6-0f72a64f6871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.685941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 771/1541] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.688082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.688364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.688634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.697820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684468d-7bde-4e28-9523-dca0a07806af None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.698162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684468d-7bde-4e28-9523-dca0a07806af None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.698644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684468d-7bde-4e28-9523-dca0a07806af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.725061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.726294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.740759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8684468d-7bde-4e28-9523-dca0a07806af None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.745116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 771/1542] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.745955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:40.747253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8684468d-7bde-4e28-9523-dca0a07806af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.761883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48750d-4871-43f1-9cf8-8c076cb995da None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:40.762865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 772/1543] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.764258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6aaf6-92a8-498f-a7e5-8c4a64580367 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.764653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6aaf6-92a8-498f-a7e5-8c4a64580367 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.765011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6aaf6-92a8-498f-a7e5-8c4a64580367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.770802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:40.771704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.772195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.772683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.773680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:40.774346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:40.776160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5462f7d-6755-4d4d-9b9f-b3e1a4e70324 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:40.786959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b0a6aaf6-92a8-498f-a7e5-8c4a64580367 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.788143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b0a6aaf6-92a8-498f-a7e5-8c4a64580367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.788767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 772/1544] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:40.789922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53ee1-c06f-4add-8f55-c19611ac4906 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.794531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53ee1-c06f-4add-8f55-c19611ac4906 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.795213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53ee1-c06f-4add-8f55-c19611ac4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.796397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 773/1545] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.797668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f02b41-139c-4900-a6a7-31ee31700aa6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.797988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f02b41-139c-4900-a6a7-31ee31700aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.798237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f02b41-139c-4900-a6a7-31ee31700aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.818011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-23f02b41-139c-4900-a6a7-31ee31700aa6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.819199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23f02b41-139c-4900-a6a7-31ee31700aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.825462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1aa53ee1-c06f-4add-8f55-c19611ac4906 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.826668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1aa53ee1-c06f-4add-8f55-c19611ac4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.827210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 774/1546] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.828227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b947-65ba-461a-b15c-2f323c75cdfb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.828506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b947-65ba-461a-b15c-2f323c75cdfb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.828782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16b947-65ba-461a-b15c-2f323c75cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.841458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 773/1547] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.843368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.843895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.844380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.854156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6a16b947-65ba-461a-b15c-2f323c75cdfb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.855401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6a16b947-65ba-461a-b15c-2f323c75cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.863854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 775/1548] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.864191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.865131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f60bd-ebd2-4b01-b3c6-38e33c7657cf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.865358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.865478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f60bd-ebd2-4b01-b3c6-38e33c7657cf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.865673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f60bd-ebd2-4b01-b3c6-38e33c7657cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.873905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 774/1549] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.874636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:40.884262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374575b6-0689-41a4-88bd-cf7f06404cd3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:40.888720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:40.889158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2e8f60bd-ebd2-4b01-b3c6-38e33c7657cf None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.889286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.889553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.889818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.890457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:40.890559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2e8f60bd-ebd2-4b01-b3c6-38e33c7657cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.891457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:40.891457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:26:40.891457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:26:40.892665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced954ad-f8c5-4c9c-b368-94474152d02c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:40.898282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 776/1550] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.899457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fa1fc-a2e5-425b-ada0-810e6ea3ffcd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.899730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fa1fc-a2e5-425b-ada0-810e6ea3ffcd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.899995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fa1fc-a2e5-425b-ada0-810e6ea3ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.918589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7e2fa1fc-a2e5-425b-ada0-810e6ea3ffcd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.919943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e2fa1fc-a2e5-425b-ada0-810e6ea3ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.931993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 777/1551] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:40.931993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.931993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.931993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.932398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 775/1552] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:40.932398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6264d6-28d7-44f1-90bc-9ac5fcf1e620 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:40.932398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6264d6-28d7-44f1-90bc-9ac5fcf1e620 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:40.932642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6264d6-28d7-44f1-90bc-9ac5fcf1e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:40.951823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.952053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7e6264d6-28d7-44f1-90bc-9ac5fcf1e620 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:40.953010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:40.953136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7e6264d6-28d7-44f1-90bc-9ac5fcf1e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:41.011055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 776/1553] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:41.014262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 778/1554] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:41.014262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.014422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd63c-b29f-47c7-856d-e7a5033ed18e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.014422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd63c-b29f-47c7-856d-e7a5033ed18e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.014422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd63c-b29f-47c7-856d-e7a5033ed18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.024296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f140-295e-40bb-9982-3634ab888d6a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.028806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.029403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.029677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.029946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.030617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.030911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.031933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:41.031933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:26:41.031933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:26:41.032805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.034825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5e0cd63c-b29f-47c7-856d-e7a5033ed18e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:41.036552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5e0cd63c-b29f-47c7-856d-e7a5033ed18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:41.044724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 779/1555] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.045906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 777/1556] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:41.046942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.047235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.047520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.047784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.059336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5874aeb-3787-40cf-a068-c8f719fae2a7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.064004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.064727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.065001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.065265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.065896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.066226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.067803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.067935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:41.069156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:41.076926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 778/1557] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:41.077691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.083924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 780/1558] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.085006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.093608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952bf17-e182-4bc1-ac1a-18d03c330e56 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.094513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e68e1-51c9-45eb-83b8-a257cb38b51b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.099307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.099539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.099893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.100104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.100276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.100377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.100547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.100645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.101182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.101309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.101473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.102224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:41.102224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:26:41.102224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:26:41.103071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.103388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72484-cdfd-458d-859f-31247c84e7bc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.116171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 779/1559] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.117327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.128149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb54ea1-9552-420e-bb3b-47f78f2536bf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.132286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 781/1560] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.132814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.133461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.133584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.133775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.133883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.134000 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.135043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.135774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.136081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.137665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.150201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 780/1561] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.151089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.152609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:41.153791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:41.162403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c9651-b59e-43f8-a1ed-b5fb107713e4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.163430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 782/1562] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:41.163430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.171386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.172720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.173002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.173276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.173690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089baf-8817-490e-9b8c-2b2c6c658eb6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.174575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.174884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.176500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.178945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.179525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.179799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.180097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.180704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.182672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.188620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 781/1563] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.189537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.205706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01f36c-3e45-4d62-b1f0-e9d72152074a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.210219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 783/1564] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.210612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.211198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.211471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.211738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.212397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.212691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.214051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.214294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.234062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 782/1565] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.234062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.237458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13567619-caad-46ed-a8ca-5ff2b7aebe9e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.257552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.267136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.286433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba823d-06e0-4804-9cf8-40e0be46e371 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.291120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.291730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.292011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.292284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.292908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.294853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.295242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.295848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.296128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.296402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.297048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.299538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.322696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 784/1566] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.323578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.329792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 783/1567] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.329792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.391588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3db931-5cd7-4034-999f-1bb1fb9dcd49 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.391803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc80735-0cc2-40fe-9bb6-2f83964d7bfd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.396898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.397217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.397646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.397858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.397986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.398182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.398324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.398453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.398869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.399081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.400685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.401029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.411026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 785/1568] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:41.411835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.421909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b97d4-a526-451d-93b2-5343f7d8b874 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.428139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.428882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.429164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.429436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.430121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:41.430424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.432135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.433111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 784/1569] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.436397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.451493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 786/1570] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:41.451493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.460817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddbe06-257d-4852-852c-1903f62e86be admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.495728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222174a-5bd8-40ec-a8a5-68680226972e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.500314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.500909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.501184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.501451 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.502691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.504588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.517430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.518087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.518367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.518636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.519246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.521171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.531237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 785/1571] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.532330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.542577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 787/1572] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.543648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.553677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75741-dadf-458e-96f0-5306e11011e9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.557869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.593082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.605923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6252a94-019b-427e-a581-441a53ae544b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.610509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.611106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.611919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.612215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.612828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.614029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.614632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.614771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.614904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.615172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.615781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.617981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.638913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 788/1573] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.639905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.644797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 786/1574] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.644797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.650153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de612e-04a3-495b-8772-be906691fbf5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.704577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648395a-933f-4398-adc0-068c2a265167 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.706171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.706782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.707092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.707362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.707984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.709357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.709915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.710066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.710235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.710502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.711135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.712718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.723130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 787/1575] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:41.724044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.732478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 789/1576] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.733357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.733665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22a267-4da6-4269-a91d-1857e007c213 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.739334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.739915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.740188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.740461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.741062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.743244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.744325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab47aa7-8c94-4549-8589-3f43fe2adf2b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.749003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.749596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.749880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.750165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.750780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.752703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.767072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 788/1577] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.767072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.774792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bda95-e8b1-4d65-b1bf-3dfbfc724c96 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.779534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.780118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.780288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 790/1578] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.780380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.780657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.780965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.781341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.783925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.809043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 789/1579] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.809043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.816672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f19568-fc43-4d61-b9d8-ef2a4f68b2a2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.844568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd6b-e6c9-42b5-8f20-daa558debdcb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.850316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.850951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.851235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.851502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.852144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.853749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.864061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 791/1580] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:41.864828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.874576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce9f20-eacd-4abb-a066-e68572482bc8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.877206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.877831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.878154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.878430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.879104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.879268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.880218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.880498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.880769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.880877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.881377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.883301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.890705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 790/1581] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:41.892125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.896982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.903788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa8fe-d3b1-4abf-80ee-c77bc499e2c3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.907883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 792/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:41.907883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.909751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.910507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.910857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.911268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] PATH_INFO: `/v3/projects/1b2e5d9fbec04a3e93755db28188b79e/users/89228d4b67e44fca9dffab4f2b85a32e/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.916129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3774bbb-fc8c-4703-8036-204b80832741 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:41.921052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:41.921725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:41.922040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:41.922315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:41.922951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.925204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.926586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b2e5d9fbec04a3e93755db28188b79e, user_id=89228d4b67e44fca9dffab4f2b85a32e, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:41.927610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:41.927610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:26:41.927610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:26:41.929557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:41.937647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 793/1583] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:41.938509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.944526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:41.945667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 791/1584] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:41 2022] PUT /identity/v3/projects/1b2e5d9fbec04a3e93755db28188b79e/users/89228d4b67e44fca9dffab4f2b85a32e/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:41.946509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:41.959552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9d693-3af3-4d47-a21b-e44e0df5f114 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.009788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11865c-08c3-4857-ac50-e602b721e39a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.014435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.015037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.015315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.015502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.015636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.016107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.016230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.016391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.016646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.017277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.018139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.018890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.029898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 794/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.030856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.041532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84903968-287e-422c-b1ac-f1315bb0b5a3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.044976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 792/1586] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:41 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:42.044976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.049611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.050234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.050512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.050782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.051414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.053025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.053355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e5e9-061c-4e65-bf94-98f1ebaab427 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.058209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.058796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.059076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.059344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.059979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.061771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.066468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 795/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.066468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.074231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa2df-c68c-48c1-9d62-7ed8b1d338fa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.074866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 793/1588] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.075729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.083470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.084215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.084567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.085062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.085753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.086290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb7edf-e2c8-4142-b467-630386b9bc69 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.087732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.091489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.092079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.092358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.092660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.093284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.094885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90dd85-e959-4a84-b28d-52dba61e1770 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.099347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 796/1589] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.099952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.110673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 794/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.110673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.110673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.110673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.111114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc6980-80a1-4de6-b466-824472e67e72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.114973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.115554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.115829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.116103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.117043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.118640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.128948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 797/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.129650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.139350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc0978-e35b-446e-93d9-ff13a387b975 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.141021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] MFA Rules not processed for user `89228d4b67e44fca9dffab4f2b85a32e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.142351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.144671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.145245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.145518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.145783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.146443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.148115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.157867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 798/1592] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.159075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.169240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc48a5-07d6-4249-affd-60a07745da23 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.174176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.174759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.175035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.175309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.175964 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.177531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.187628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 799/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.187628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.197584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cde0-fc7f-4c1a-98cc-647448c805e6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.202145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.202706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.202983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.203280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.203896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.205996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.210208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 795/1594] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.211022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.216467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 800/1595] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.217304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.222516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2835-c8c1-4573-b14d-37fff5c88b96 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.227321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.227972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.228249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.228354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073245-88c3-4f55-8a49-88757a1001fe admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.228764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] PATH_INFO: `/v3/projects/58fb14530132434d959da285830fa9b6/users/21e14b8bcd4442168c2d1b7cfc956dce/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.232955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.233646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.233929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.234266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] PATH_INFO: `/v3/projects/9a03094fc4d642eba293cbb9b8441165/users/65a8f63cfd304811a4feb48ea9776ec0/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.245700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fb14530132434d959da285830fa9b6, user_id=21e14b8bcd4442168c2d1b7cfc956dce, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.248544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.254162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a03094fc4d642eba293cbb9b8441165, user_id=65a8f63cfd304811a4feb48ea9776ec0, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.257578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.264771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 796/1596] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/58fb14530132434d959da285830fa9b6/users/21e14b8bcd4442168c2d1b7cfc956dce/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.265736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.274375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 801/1597] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/9a03094fc4d642eba293cbb9b8441165/users/65a8f63cfd304811a4feb48ea9776ec0/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.275600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.290437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.341657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb7faa-2ccd-4b8e-94e8-0879c573e1fe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.346511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.347259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.347604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.347945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.348696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.350914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.353669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc7315-7640-4360-a8ab-920adeb8f475 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.358512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.359254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.359515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.359788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] PATH_INFO: `/v3/projects/177d0707c9d1494abc77c714e31fa15f/users/be489ecec19847829df7c4488986373e/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.361077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 797/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.361987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.374954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5390f2-c5b0-4cf5-95a3-8a0d8ec9e1fc admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.376443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177d0707c9d1494abc77c714e31fa15f, user_id=be489ecec19847829df7c4488986373e, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.379236 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.379643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.380289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.380563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.380828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] PATH_INFO: `/v3/projects/3c491181ae054706be3bdc94c61501f9/users/c11d183b3c0c4b2b83f3b52b881a72cf/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.381453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.394895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 802/1599] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/177d0707c9d1494abc77c714e31fa15f/users/be489ecec19847829df7c4488986373e/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.395968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.401369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c491181ae054706be3bdc94c61501f9, user_id=c11d183b3c0c4b2b83f3b52b881a72cf, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.404529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.418466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 798/1600] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/3c491181ae054706be3bdc94c61501f9/users/c11d183b3c0c4b2b83f3b52b881a72cf/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.422865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.458922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3e67b-258c-49e8-9fe8-0aff57131578 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.484661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec017873-4a11-4e5e-987b-66be6e81c02d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.489471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.490185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.490469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.490744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] PATH_INFO: `/v3/projects/2c3f36e86c51479c9bbe844a650ca355/users/ca68ccce2ae54eccbfb1afd171424746/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.506743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3f36e86c51479c9bbe844a650ca355, user_id=ca68ccce2ae54eccbfb1afd171424746, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.509635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585fafc-15da-453c-9130-521c9a38d8b3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.515770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.516561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.516913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.517191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.518445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.520465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef13ef-4e2a-4b6c-a3c6-96b015d70ebe admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.524162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 799/1601] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/2c3f36e86c51479c9bbe844a650ca355/users/ca68ccce2ae54eccbfb1afd171424746/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.525454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db68d5-42d3-404d-9b95-55336c10ad96 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.525866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db68d5-42d3-404d-9b95-55336c10ad96 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.526161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db68d5-42d3-404d-9b95-55336c10ad96 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.527412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 800/1602] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 17 07:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:26:42.531684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.531972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.532246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.533552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 803/1603] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:42.534890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d6a5-d857-4596-b119-60e610870e44 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.535106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d6a5-d857-4596-b119-60e610870e44 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.535381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d6a5-d857-4596-b119-60e610870e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.552215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.553425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.561950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-27a8d6a5-d857-4596-b119-60e610870e44 None None] MFA Rules not processed for user `65a8f63cfd304811a4feb48ea9776ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.563187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-27a8d6a5-d857-4596-b119-60e610870e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.614560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 801/1604] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.614560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.622463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad54037-d474-4966-8fe5-4c267428a4a4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.627541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.628195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.628399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 804/1605] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.632938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.632938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] PATH_INFO: `/v3/projects/99d9a3fa9369495ab6d8da88f3d9dbd5/users/f8b0c96c80db4db4a477a1fa6c1fa4db/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.633172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88670-6011-499a-ba4d-bb0683ca04fb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.633172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88670-6011-499a-ba4d-bb0683ca04fb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.633172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb88670-6011-499a-ba4d-bb0683ca04fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.634739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.649508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d9a3fa9369495ab6d8da88f3d9dbd5, user_id=f8b0c96c80db4db4a477a1fa6c1fa4db, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.652361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fe078-2f10-4b51-bea6-386542887a03 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.652959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ecb88670-6011-499a-ba4d-bb0683ca04fb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.654216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ecb88670-6011-499a-ba4d-bb0683ca04fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.664080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 805/1606] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.665520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.665936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.666453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.666742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 802/1607] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/99d9a3fa9369495ab6d8da88f3d9dbd5/users/f8b0c96c80db4db4a477a1fa6c1fa4db/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.668190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6737-e70c-4873-915c-44e4a3de92ac None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.668631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6737-e70c-4873-915c-44e4a3de92ac None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.669038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae6737-e70c-4873-915c-44e4a3de92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.688957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5fae6737-e70c-4873-915c-44e4a3de92ac None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.690743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5fae6737-e70c-4873-915c-44e4a3de92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.692918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.694101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.707649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.749547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 803/1608] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.750817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526f32-c0de-4f54-980b-fff2a005a111 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.751096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526f32-c0de-4f54-980b-fff2a005a111 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.751362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526f32-c0de-4f54-980b-fff2a005a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.762318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 806/1609] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.763487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.774732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579b1f-7305-4724-9c5e-3cbe155eaa15 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.779341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.779983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.780257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.780555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] PATH_INFO: `/v3/projects/440c8121d74c4f8884f8cdfb84678792/users/7afc7920017d4600afa44ac58a7714e8/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.791443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-de526f32-c0de-4f54-980b-fff2a005a111 None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.792654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-de526f32-c0de-4f54-980b-fff2a005a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.795168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c8121d74c4f8884f8cdfb84678792, user_id=7afc7920017d4600afa44ac58a7714e8, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.797876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.811061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 807/1610] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:42 2022] PUT /identity/v3/projects/440c8121d74c4f8884f8cdfb84678792/users/7afc7920017d4600afa44ac58a7714e8/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:42.811859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.813388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.871159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117a1aa-9398-4d20-b31a-853e8d788b37 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.871408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 804/1611] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.872491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6262e-3bab-4804-a740-3b4ce56682fa None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.872789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6262e-3bab-4804-a740-3b4ce56682fa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.873062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6262e-3bab-4804-a740-3b4ce56682fa None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.874344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 805/1612] 10.222.0.45 () {54 vars in 962 bytes} [Wed Aug 17 07:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:26:42.878943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.879478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.879830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.879952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.880106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.880225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.880847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.898271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:42.899471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:42.942255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.943693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.953210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 808/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:42.955183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.961656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 806/1614] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:42.962534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:42.966632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3226f4b-989e-48e1-95f1-934dee9c5aab service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.969140 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:42.970663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.971270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.971548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.971821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.975129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849770-a0b9-4c7e-b1bd-b480bb8003f7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:42.979615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:42.980447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:42.980945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:42.981398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:42.983365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.985315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.992157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:42.993575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b3d1d-e8ad-49a3-b948-612619265754 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:42.998132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 809/1615] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.000511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.004353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 807/1616] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.005589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f51e6-a74b-4d2b-aba8-4828aa23ed5f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.005869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f51e6-a74b-4d2b-aba8-4828aa23ed5f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.006161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f51e6-a74b-4d2b-aba8-4828aa23ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.012327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d08b3-f183-4b19-ae87-bd9519153e17 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.019155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.020746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.021096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.021374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.037396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.040983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.041529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-415f51e6-a74b-4d2b-aba8-4828aa23ed5f None None] MFA Rules not processed for user `7afc7920017d4600afa44ac58a7714e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:43.043354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-415f51e6-a74b-4d2b-aba8-4828aa23ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:43.058840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 810/1617] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.060895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.090071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:43.135894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 808/1618] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:43.137563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.137850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.138163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.160225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62d0c5-4ee8-4b15-8be1-e1e7517b92b0 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.164511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:43.165931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:43.174829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.175691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.176068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.176494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.178222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 809/1619] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Aug 17 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:43.179284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.194492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb66f6d-1e88-463b-bdff-43a152ea212a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.199826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.200705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.201290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.201578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.215053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.216871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.238641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 810/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.240269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.278180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.279962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.300980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 811/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.302688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.321104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1fca8-be0d-479d-b31a-d24469b4f244 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.324015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f533-941e-4b6e-aca2-2a1b9fb053bd service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.326422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.327141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.327527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.327940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.337916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.339516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cbc6f-494d-445d-8ecc-f95a0e46c4bd service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.341518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.342172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.342578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.342882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.359564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 811/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.489717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.493088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc6bc-9ce3-410e-a69f-93309d479d3a service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.534096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 812/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.703170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7af64-5a38-4a67-9a73-1e8c6e9b34a6 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.703800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7af64-5a38-4a67-9a73-1e8c6e9b34a6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.703933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7af64-5a38-4a67-9a73-1e8c6e9b34a6 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.706235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 812/1624] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 17 07:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:26:43.714081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f134dd-6aeb-49b1-bddc-3912df5dc467 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.714592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f134dd-6aeb-49b1-bddc-3912df5dc467 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.714898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f134dd-6aeb-49b1-bddc-3912df5dc467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.749901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-07f134dd-6aeb-49b1-bddc-3912df5dc467 None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:43.753720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-07f134dd-6aeb-49b1-bddc-3912df5dc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:43.774749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 813/1625] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:26:43.789899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7af64-5a38-4a67-9a73-1e8c6e9b34a6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:43.805178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7af64-5a38-4a67-9a73-1e8c6e9b34a6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:43.814817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:43.816070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.816799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.817805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.854265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:43.862308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f828b3c-358e-46be-bb0f-5f1ddcb6fff9 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:43.904217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 813/1626] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:43.940369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa206c-7462-4ff4-a3cf-b630163fbe30 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.940673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa206c-7462-4ff4-a3cf-b630163fbe30 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.940916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa206c-7462-4ff4-a3cf-b630163fbe30 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.942670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 814/1627] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 17 07:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:26:43.950331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:43.951207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:43.951853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:43.987389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:43.988862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:44.008567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 814/1628] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:44.332127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa206c-7462-4ff4-a3cf-b630163fbe30 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:44.359454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa206c-7462-4ff4-a3cf-b630163fbe30 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:44.371466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:44.372178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:44.372456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:44.373159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:44.385795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:44.387349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec0ae8-b49f-41fa-a43b-7ae3664515d4 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:44.412208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 815/1629] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:44.699180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:44.730602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2fac-239e-4895-ab87-dd5524cc956b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:44.738047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:44.738703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:44.738978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:44.739425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] PATH_INFO: `/v3/users/65a8f63cfd304811a4feb48ea9776ec0` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:44.740753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a8f63cfd304811a4feb48ea9776ec0)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:44.742238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:44.742238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 17 07:26:44.742238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: Aug 17 07:26:44.744402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:44.877506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:44.905607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a8f63cfd304811a4feb48ea9776ec0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:44.906946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a8f63cfd304811a4feb48ea9776ec0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:44.969370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a8f63cfd304811a4feb48ea9776ec0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:44.970768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a8f63cfd304811a4feb48ea9776ec0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:44.981913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a8f63cfd304811a4feb48ea9776ec0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:45.015764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 815/1630] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:26:44 2022] DELETE /identity/v3/users/65a8f63cfd304811a4feb48ea9776ec0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:45.018509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:45.019421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:45.019900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:45.041059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:45.042437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:45.076534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:45.122399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 816/1631] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:45.162102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:45.163920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:45.289319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275af2a-c370-4dae-ac80-64d07ff2ecd4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:45.296340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:45.297309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:45.297848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:45.299205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:45.311997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:45.315677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f4016-b540-43e2-8bee-b2834b10f602 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:45.336143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 816/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:26:47.379049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:47.380532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:47.402979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f8069-1107-41dd-8ccb-e796bd4298de None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:47.413644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:47.422432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:47.422883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:47.423338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] PATH_INFO: `/v3/projects/9a03094fc4d642eba293cbb9b8441165` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:47.424909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a03094fc4d642eba293cbb9b8441165)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:47.426156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: WARNING py.warnings [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 07:26:47.426156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: warnings.warn(msg) Aug 17 07:26:47.426156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: Aug 17 07:26:47.427633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:47.576029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a03094fc4d642eba293cbb9b8441165', 'request_id': 'req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:47.576029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a03094fc4d642eba293cbb9b8441165', 'request_id': 'req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:47.615272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a03094fc4d642eba293cbb9b8441165', 'request_id': 'req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:47.656032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] The token cache is being invalidate because project 9a03094fc4d642eba293cbb9b8441165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:26:47.656903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:47.659137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b1ec9d8f-1543-46b6-8a49-e82fd08e23c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:47.664549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 817/1633] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:26:47 2022] DELETE /identity/v3/projects/9a03094fc4d642eba293cbb9b8441165 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:47.670579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:47.671239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:47.671239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:47.703124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:47.704373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:47.785019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 817/1634] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:47.786281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:47.786584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:47.786855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:47.830943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:47.834246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:47.855589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 818/1635] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:26:47.860272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:47.875281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f56f5e-8525-4dbf-898e-1ec2009ac8cc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:47.891825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:47.893057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:47.893440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:47.893803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:47.894509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:47.894993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:47.896554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:47.933970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 818/1636] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:47.950918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:47.980812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24de62-74b8-49e2-a55e-8ac0b6e03b5b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:47.994366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:47.996311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:47.999859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.000152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.003004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.009175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:48.088113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 819/1637] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:47 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:48.089505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:48.111391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbeee-55b4-4e1b-bf86-0a9c137f02d0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:48.216782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:48.253062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:48.254256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.254803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.255443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.256444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.260035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:48.294786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 819/1638] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:48 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:48.298950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:48.331323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf953ae2-2b68-43cc-a10b-0c7ff0d51d40 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:48.344127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:48.345289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.345289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.352499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.352499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.352499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:48.374683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:48.375360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 820/1639] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:48.394720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5051921-6c13-4e27-b2f4-1ef89d524527 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:48.401871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:48.402172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.402449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.402717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.403487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.406483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21137d04-25a2-4218-8536-917515cb04be admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:48.425688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 820/1640] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:26:48.429780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:48.445720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21769fc-36e1-4ff2-ac10-29d2d190181d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:48.451465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:48.452444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.452862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.453855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] PATH_INFO: `/v3/projects/9218610011364746b943fee9b2b21c52/users/e55c3a1f40f04fe3a15a0bf7a7d4426b/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.476998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9218610011364746b943fee9b2b21c52, user_id=e55c3a1f40f04fe3a15a0bf7a7d4426b, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.481419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:48.518333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 821/1641] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:48 2022] PUT /identity/v3/projects/9218610011364746b943fee9b2b21c52/users/e55c3a1f40f04fe3a15a0bf7a7d4426b/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:48.542447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.542960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.543241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.593883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] MFA Rules not processed for user `e55c3a1f40f04fe3a15a0bf7a7d4426b`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:48.595193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:48.739557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 821/1642] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:48.744162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:48.905361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:48.919455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22931e5-148b-4bed-9338-e5bcf5f61148 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:48.933528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:48.934494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:48.934776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:48.938532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:48.940086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:48.949687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.016154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 822/1643] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:48 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:49.018743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:49.043487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a6ea-7c73-4d5e-9b49-d958d1a6e3da None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:49.359485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:49.360120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.369723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.370169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.372085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:49.374104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.422686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 822/1644] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:49 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:49.426512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:49.446691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c29b78-69dc-4dc0-b488-e97e14cb3e65 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:49.490072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:49.492899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.493181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.493454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.495561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:49.498307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.521898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 823/1645] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:49.522710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:49.543518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527bc45-bd10-4c9d-86f3-ce4d40d060e6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:49.565111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:49.565823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.566308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.566589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] PATH_INFO: `/v3/projects/f1fe654e88d345c1b7813afc31b25e42/users/534242769e1b49febcb393877861a520/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.601640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fe654e88d345c1b7813afc31b25e42, user_id=534242769e1b49febcb393877861a520, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:49.608574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.644519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 823/1646] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:49 2022] PUT /identity/v3/projects/f1fe654e88d345c1b7813afc31b25e42/users/534242769e1b49febcb393877861a520/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:26:49.646466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:49.669791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64674-89ea-4029-bebd-8185d8e1f0d6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:49.797205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:49.798982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.800088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.800459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.802493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:49.807042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15f98e-10b8-4872-8b5a-912dcd4c6d4a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.830837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 824/1647] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:49.834720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:49.853006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3792-939a-465e-be4b-085d62d1c322 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:49.862250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:49.863570 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.864020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.864667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] PATH_INFO: `/v3/projects/f1fe654e88d345c1b7813afc31b25e42/users/534242769e1b49febcb393877861a520/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.867704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fe654e88d345c1b7813afc31b25e42, user_id=534242769e1b49febcb393877861a520, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:49.873195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:49.893450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 824/1648] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:49 2022] PUT /identity/v3/projects/f1fe654e88d345c1b7813afc31b25e42/users/534242769e1b49febcb393877861a520/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:26:49.905094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:49.905697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:49.906163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:49.960843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] MFA Rules not processed for user `534242769e1b49febcb393877861a520`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:49.962948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:50.211411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 825/1649] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:50.223628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:50.226204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:50.240267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:50.469927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799ec0-e7d7-434e-a917-fde88775bb7b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:50.484796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:50.489393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:50.489860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:50.490309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:50.541883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:50.548190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a18985-3e97-43cc-a9b6-fd38e6d144c1 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:50.608986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 825/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:51.764654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:51.992261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:52.041454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213253a-f525-49a0-afe4-c69d05ed30e8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:52.056252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:52.056914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:52.057199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:52.057579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] PATH_INFO: `/v3/users/e55c3a1f40f04fe3a15a0bf7a7d4426b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:52.059538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55c3a1f40f04fe3a15a0bf7a7d4426b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:52.061565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:52.277912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55c3a1f40f04fe3a15a0bf7a7d4426b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:52.282135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55c3a1f40f04fe3a15a0bf7a7d4426b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:52.331988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55c3a1f40f04fe3a15a0bf7a7d4426b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:52.354319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55c3a1f40f04fe3a15a0bf7a7d4426b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:52.406630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55c3a1f40f04fe3a15a0bf7a7d4426b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:52.422797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 826/1651] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:26:51 2022] DELETE /identity/v3/users/e55c3a1f40f04fe3a15a0bf7a7d4426b => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:52.427607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:52.428052 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:52.428210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:52.471892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:52.473148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:52.652573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 826/1652] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:26:52.677503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:52.679272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:52.830765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa3f-1da6-4618-a05f-129b8be5f8e4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:52.835094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:52.835816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:52.836751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:52.837152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:52.852716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:52.854661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ae648-5c1f-47b7-984a-d8d33f9a0498 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:52.874993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 827/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:53.839377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:53.841026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:53.871938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310968-8e23-4f96-85fc-93d2a3bb004c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:53.900827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:53.901506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:53.901790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:53.902093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] PATH_INFO: `/v3/users/89228d4b67e44fca9dffab4f2b85a32e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:53.903967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=89228d4b67e44fca9dffab4f2b85a32e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:53.907396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:54.029748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89228d4b67e44fca9dffab4f2b85a32e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.031236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89228d4b67e44fca9dffab4f2b85a32e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.067297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89228d4b67e44fca9dffab4f2b85a32e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.068134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89228d4b67e44fca9dffab4f2b85a32e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.084467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89228d4b67e44fca9dffab4f2b85a32e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.109685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 827/1654] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:26:53 2022] DELETE /identity/v3/users/89228d4b67e44fca9dffab4f2b85a32e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:54.112364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:54.112829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:54.112940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:54.152811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:54.154096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:54.312651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 828/1655] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:54.383350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:54.385214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:54.442716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:54.504164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:54.509026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:54.536965 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef695a-9c61-4964-8547-b2f251aa0571 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:54.557900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:54.563143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:54.567280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:54.569935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] PATH_INFO: `/v3/projects/9218610011364746b943fee9b2b21c52` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:54.574810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9218610011364746b943fee9b2b21c52)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:54.580446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:54.582220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf9ff1-6fa2-4fd1-ac97-41173173b1fb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:54.595772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:54.596465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:54.596891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:54.597175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:54.602469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:54.627154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:54.629070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:54.653822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 828/1656] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:54.674686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9218610011364746b943fee9b2b21c52', 'request_id': 'req-c14affe3-8bcf-46a1-befa-7310419bddb2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.682433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9218610011364746b943fee9b2b21c52', 'request_id': 'req-c14affe3-8bcf-46a1-befa-7310419bddb2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.698274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9218610011364746b943fee9b2b21c52', 'request_id': 'req-c14affe3-8bcf-46a1-befa-7310419bddb2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.719551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] The token cache is being invalidate because project 9218610011364746b943fee9b2b21c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:26:54.720020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.721985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c14affe3-8bcf-46a1-befa-7310419bddb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.726746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 829/1657] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:26:54 2022] DELETE /identity/v3/projects/9218610011364746b943fee9b2b21c52 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:26:54.730803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:54.743792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087ec4-161c-4f17-bd94-d384df845a8a service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:54.861424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:54.862474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:54.865722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:54.865722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] PATH_INFO: `/v3/users/534242769e1b49febcb393877861a520` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:54.865722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534242769e1b49febcb393877861a520)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:54.868022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:54.952912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534242769e1b49febcb393877861a520'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.955226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534242769e1b49febcb393877861a520'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.976730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534242769e1b49febcb393877861a520'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.978111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534242769e1b49febcb393877861a520'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:54.993743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534242769e1b49febcb393877861a520'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:55.020108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 829/1658] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:26:54 2022] DELETE /identity/v3/users/534242769e1b49febcb393877861a520 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:55.240493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:55.241020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:55.243367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:55.377010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] MFA Rules not processed for user `21e14b8bcd4442168c2d1b7cfc956dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:55.378398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:55.510104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 830/1659] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:55.526355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:55.528290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:55.606905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:55.647695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1bd11-7dd8-48ba-88e0-1dc72e706516 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:55.655246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:55.655941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:55.656387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:55.656900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:55.669591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:55.671334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31b421-b361-4e66-bf1e-1e8f48ebfca0 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:55.684980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 830/1660] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:55.984312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:55.987475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:56.162763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb4581-aebf-4d4d-b902-075455490660 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:56.174883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:56.175936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.175936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.176131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] PATH_INFO: `/v3/projects/1b2e5d9fbec04a3e93755db28188b79e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.179197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b2e5d9fbec04a3e93755db28188b79e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:56.181230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:56.257520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:56.292798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2e5d9fbec04a3e93755db28188b79e', 'request_id': 'req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.315592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2e5d9fbec04a3e93755db28188b79e', 'request_id': 'req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.334354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2e5d9fbec04a3e93755db28188b79e', 'request_id': 'req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.364847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] The token cache is being invalidate because project 1b2e5d9fbec04a3e93755db28188b79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:26:56.366107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.369258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-52785cc3-a6ac-4f1a-9319-c72ed4b5e63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.371079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 831/1661] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:26:55 2022] DELETE /identity/v3/projects/1b2e5d9fbec04a3e93755db28188b79e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:56.378044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.380118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.380659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.420764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:56.423957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:56.634905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 831/1662] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:56.644544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.644544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.645023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.679624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:56.681779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:56.682568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:56.686237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:56.707938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d20824-b2a1-4334-b6ba-e54c6063c6e6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:56.713330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 832/1663] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:56.714603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:56.722357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:56.724248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.724552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.724831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] PATH_INFO: `/v3/users/7afc7920017d4600afa44ac58a7714e8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.727726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afc7920017d4600afa44ac58a7714e8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:56.732940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:56.735690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04e59-4504-4d07-8b0f-c2bd62b929a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:56.745459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:56.746284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.746675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.747074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.747848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:56.748257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:56.754254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:56.789494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 833/1664] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:56.790697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:56.813487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d48c6-b367-4485-9eaa-e63b920b7698 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:56.827599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:56.828234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.831184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.831866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:56.832553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:56.836909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:56.863323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afc7920017d4600afa44ac58a7714e8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.865752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afc7920017d4600afa44ac58a7714e8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.898577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afc7920017d4600afa44ac58a7714e8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.900750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afc7920017d4600afa44ac58a7714e8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.902257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 834/1665] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:56 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:56.906849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:56.911036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:56.912460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b7395913-4f98-46a4-acc0-ef45eebafaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afc7920017d4600afa44ac58a7714e8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:56.932668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 832/1666] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:26:56 2022] DELETE /identity/v3/users/7afc7920017d4600afa44ac58a7714e8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:26:56.944776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:56.945628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:56.946173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.008351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:57.011691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.124608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:57.148742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d9ee2-4328-471c-b087-0bfc139f901e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.179997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 833/1667] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:57.181026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.183305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.213658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e943fa-5cc7-49c5-9d4e-9499d0230f77 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.225777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.226610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.226995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.227380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] PATH_INFO: `/v3/projects/f1fe654e88d345c1b7813afc31b25e42` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.229302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fe654e88d345c1b7813afc31b25e42)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.231409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.307643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.309805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.310277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.311498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.313086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.319087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.338681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fe654e88d345c1b7813afc31b25e42', 'request_id': 'req-025d8db7-fb3f-4803-ab6b-96713c798030'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:57.349493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fe654e88d345c1b7813afc31b25e42', 'request_id': 'req-025d8db7-fb3f-4803-ab6b-96713c798030'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:57.370953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fe654e88d345c1b7813afc31b25e42', 'request_id': 'req-025d8db7-fb3f-4803-ab6b-96713c798030'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:57.380712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 835/1668] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:56 2022] POST /identity/v3/users => generated 302 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:26:57.382605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.385034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.388000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] The token cache is being invalidate because project f1fe654e88d345c1b7813afc31b25e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:26:57.391466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:57.394301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:26:57.396440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 834/1669] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:26:57 2022] DELETE /identity/v3/projects/f1fe654e88d345c1b7813afc31b25e42 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:57.401091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.406300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:57.408676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.498247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d8db7-fb3f-4803-ab6b-96713c798030 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.508028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.508847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.509687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.509687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.510510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.512816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37581700-ef29-4997-b28a-fccd76a47a23 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.517201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9119c0-9ec0-4786-b39a-1d8cdca74772 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.525808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 835/1670] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:57.528901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.529323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.529838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.554739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:57.556220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.565493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 836/1671] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:57.566591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.577340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd601c-cbaf-4e39-a816-155fbc100d61 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.583367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.584065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.584412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.584750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.585521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.588156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c24f3b-be3f-4f8a-b311-6301d80703e1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.599869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 837/1672] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:57.601067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.601359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.601686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.632855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:57.637519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.638548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.643020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.643493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.644793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.651961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:57.652792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 838/1673] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:57.653707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.695498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.701620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219142d8-38ba-4e28-ba3b-36ec4d8ba71b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.701782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.707921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.733547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.733839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.734142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] PATH_INFO: `/v3/projects/ffec65e760e9482d8611e9bd10500600/users/98e99a8f38d44e3c89040962bb810bb5/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.747646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 836/1674] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:26:57.749362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.773975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283799-93de-4f30-b108-4830d4185f3e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.786469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:57.787094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.787368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.787630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.788277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:26:57.788573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.799717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.821308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffec65e760e9482d8611e9bd10500600, user_id=98e99a8f38d44e3c89040962bb810bb5, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:57.831626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395cef1-4033-4db2-859f-80e259f0c49a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:57.834385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 837/1675] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:26:57.837673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:57.864115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 839/1676] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:57 2022] PUT /identity/v3/projects/ffec65e760e9482d8611e9bd10500600/users/98e99a8f38d44e3c89040962bb810bb5/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:57.864362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842612-fcea-452d-a961-10732be2bad1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:57.879164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:57.879763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:57.880174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:57.947894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:57.972787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] MFA Rules not processed for user `98e99a8f38d44e3c89040962bb810bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:57.975599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:58.081291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.081841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.082153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.082433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.083059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.095558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.117134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 840/1677] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:58.121234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.137545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d602bc4-10aa-4c41-b03b-6db03fd5b1bf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.149795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.150781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.151293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.151707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.152488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.155228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.165633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 838/1678] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:57 2022] POST /identity/v3/projects => generated 365 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:58.166715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.190819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 841/1679] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:58 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:26:58.194746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.271639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d9cd3-b380-4f35-9ab9-5b2c8b5b64a1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.273666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:58.285925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.286576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.286854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.287122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.287754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.291363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.311481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806960-82d2-44b9-922b-6c24b30ada78 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.318039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.319172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.319448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.320295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.320846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.323242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.343761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 842/1680] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:58 2022] POST /identity/v3/users => generated 309 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:26:58.344856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.362838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 839/1681] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:58 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:58.363775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.370943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8114-6e6f-4aa2-838f-54a48e7b1634 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.382960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.383588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.383863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.384131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.385112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.389796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef2c6-95f1-45ce-b2f5-a139395cdaad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.390959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.401260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.401886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.402186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.402453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.403103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.406815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.415408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 843/1682] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:58.420765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.434460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 840/1683] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:58.437028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.441119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e396-dd5d-404e-89ca-6404737e26d4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.449899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f91d9-35d8-49ee-90b3-d8c436de0002 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.452404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.453157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.453560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.453901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] PATH_INFO: `/v3/projects/213cd2e4122042548beb752ef4482b92/users/3f3387f0f5724d3a9875f126bb7fedc1/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.470876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.471754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.472218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.472685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.473617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.478725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.491866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=213cd2e4122042548beb752ef4482b92, user_id=3f3387f0f5724d3a9875f126bb7fedc1, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.495800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.507749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 841/1684] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:58.510864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.527519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 844/1685] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:58 2022] PUT /identity/v3/projects/213cd2e4122042548beb752ef4482b92/users/3f3387f0f5724d3a9875f126bb7fedc1/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:58.532593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.533928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258db70-778f-4cb0-8950-9b9716f03f48 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.671914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:58.746945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.748903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0164a7-6fcd-48bc-9943-86058f33a01f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.750953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.751457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.752880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] PATH_INFO: `/v3/projects/bff8f66c27254c7b8e9150fca909ee1f/users/5f13a31a5f924fa3b87774a5c4d0195b/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.770421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.774928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.775221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.777762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.780516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.782199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.784857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff8f66c27254c7b8e9150fca909ee1f, user_id=5f13a31a5f924fa3b87774a5c4d0195b, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.789396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68c3a-7d20-477f-a96c-7cde7c54c5ca admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:58.810778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 845/1686] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:58.815740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:58.832232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 842/1687] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:58 2022] PUT /identity/v3/projects/bff8f66c27254c7b8e9150fca909ee1f/users/5f13a31a5f924fa3b87774a5c4d0195b/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:26:58.834323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a920-4139-486a-95e4-54971a5d176c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:58.844686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.844900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.845710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.903660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] MFA Rules not processed for user `5f13a31a5f924fa3b87774a5c4d0195b`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:58.905424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:58.977652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:58.978418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:58.979588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:58.979877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] PATH_INFO: `/v3/projects/213cd2e4122042548beb752ef4482b92/users/3f3387f0f5724d3a9875f126bb7fedc1/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:58.989539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] RBAC: Authorizing `identity:create_grant(project_id=213cd2e4122042548beb752ef4482b92, user_id=3f3387f0f5724d3a9875f126bb7fedc1, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:58.997102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fafd8-817d-42de-aea6-9779d5d9798d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.015409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 846/1688] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:58 2022] PUT /identity/v3/projects/213cd2e4122042548beb752ef4482b92/users/3f3387f0f5724d3a9875f126bb7fedc1/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:59.026357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.026852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.027267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.064674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 843/1689] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:59.066672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.112199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] MFA Rules not processed for user `3f3387f0f5724d3a9875f126bb7fedc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:26:59.114789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:59.118546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e31ef-a862-46b9-94ba-20731cd88714 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:59.179395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:59.308581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:59.310875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.311100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.313029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.313797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:59.317177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.342116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 847/1690] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:26:59.361731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.363241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:26:59.437927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 844/1691] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:26:59 2022] POST /identity/v3/projects => generated 363 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:26:59.442952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.524889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:26:59.535276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc7d27-1e6d-4a58-91a7-f4fdc36b3841 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:59.565171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7054-ac8d-49fa-a113-acef927532b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:59.578988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:59.581559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.583500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.583943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.584808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:59.590778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.651261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 845/1692] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:26:59 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:26:59.654912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.682692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3945-d113-45e3-b886-afd633d47b87 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:59.691046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:59.693040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.693321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.693588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.694657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:59.695270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.695583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.695848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.696869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:59.699055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.727686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 846/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:26:59.731729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.763720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e242dd-affa-41bb-98a5-23cf3eb1e6d8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:26:59.778990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:26:59.779674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:26:59.779949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:26:59.782062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] PATH_INFO: `/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1/users/085116c3d6cf49f5a035745575aef7b1/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:26:59.823513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f065c8c4cedf4c91bf32054391a8a7f1, user_id=085116c3d6cf49f5a035745575aef7b1, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:59.826760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.860182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:26:59.862276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:26:59.867142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 847/1694] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:26:59 2022] PUT /identity/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1/users/085116c3d6cf49f5a035745575aef7b1/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:26:59.871585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:26:59.878297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 848/1695] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:26:59 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:00.026920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd05e-afd0-434a-a6d1-6105346568ee admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:00.053645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:00.058925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.060146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.060423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.062111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:00.064864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c386662-88dc-4ce6-b105-5489feb3f236 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:00.068253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:00.098816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:00.113924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 848/1696] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:00.129980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a44209-a2d3-40f3-bab1-74b4100948e1 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:00.147448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:00.148974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.149485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.150013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] PATH_INFO: `/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1/users/085116c3d6cf49f5a035745575aef7b1/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.157360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f065c8c4cedf4c91bf32054391a8a7f1, user_id=085116c3d6cf49f5a035745575aef7b1, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:00.161296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:00.201300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 849/1697] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:00 2022] PUT /identity/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1/users/085116c3d6cf49f5a035745575aef7b1/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:00.212240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.212637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.212912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.237281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:00.301838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] MFA Rules not processed for user `085116c3d6cf49f5a035745575aef7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:00.306641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:00.437147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a31ce-d1ae-410c-a314-6df10fe02489 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:00.471320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:00.472422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.473463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.476887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] PATH_INFO: `/v3/users/98e99a8f38d44e3c89040962bb810bb5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.477527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e99a8f38d44e3c89040962bb810bb5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:00.487318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:00.583968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:00.587035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 849/1698] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:00.587943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:00.588310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e99a8f38d44e3c89040962bb810bb5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.589630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e99a8f38d44e3c89040962bb810bb5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.603151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:00.616126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e99a8f38d44e3c89040962bb810bb5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.618228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e99a8f38d44e3c89040962bb810bb5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.639040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e99a8f38d44e3c89040962bb810bb5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.649367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60ad4f-0a8b-4fb1-ae02-0a1c2127fad3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:00.655971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 850/1699] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:00 2022] DELETE /identity/v3/users/98e99a8f38d44e3c89040962bb810bb5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:00.657649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:00.660849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:00.667648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:00.668314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.668592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.668845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] PATH_INFO: `/v3/projects/440c8121d74c4f8884f8cdfb84678792` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.678956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440c8121d74c4f8884f8cdfb84678792)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:00.681119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:00.844568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440c8121d74c4f8884f8cdfb84678792', 'request_id': 'req-eb57264d-2f75-4b07-a31b-ed6ae3b83903'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.860354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440c8121d74c4f8884f8cdfb84678792', 'request_id': 'req-eb57264d-2f75-4b07-a31b-ed6ae3b83903'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.861723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e65a1-9b12-4e88-a568-1fbfc37b7739 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:00.879571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440c8121d74c4f8884f8cdfb84678792', 'request_id': 'req-eb57264d-2f75-4b07-a31b-ed6ae3b83903'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.905437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] The token cache is being invalidate because project 440c8121d74c4f8884f8cdfb84678792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:00.906831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.909298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eb57264d-2f75-4b07-a31b-ed6ae3b83903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:00.912501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 850/1700] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:00 2022] DELETE /identity/v3/projects/440c8121d74c4f8884f8cdfb84678792 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:00.922378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4147-fabb-404a-895b-58f80d675c71 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:00.922733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4147-fabb-404a-895b-58f80d675c71 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:00.923111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4147-fabb-404a-895b-58f80d675c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:00.976143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b3ab4147-fabb-404a-895b-58f80d675c71 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:00.987534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b3ab4147-fabb-404a-895b-58f80d675c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.016960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.017594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.017875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.018188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.023211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.112458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 851/1701] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:01.113982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f808bd-fb03-4b87-8319-f0f3a2041618 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.124412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f808bd-fb03-4b87-8319-f0f3a2041618 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.124412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f808bd-fb03-4b87-8319-f0f3a2041618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.135112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:01.155275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:01.189440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:01.194717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 851/1702] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:01.201945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:01.207428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.209031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-88f808bd-fb03-4b87-8319-f0f3a2041618 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:01.210356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-88f808bd-fb03-4b87-8319-f0f3a2041618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.254711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 852/1703] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:01.267663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.267957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.268229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.358282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:01.360736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:01.378673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.408633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 853/1704] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:01.413297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:01.416514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.436315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224835-e752-4b36-81e6-5b336b40ec2e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:01.450257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039212-1d8c-40a2-8c83-8f1357c82238 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:01.451009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.451752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.452136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.452515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.463835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.464643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.465076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.466958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.470672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:01.471347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.472886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:01.512941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 852/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:01.514054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:01.533272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f7c9-a71f-4b07-b94c-2649be4928ad service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:01.548644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.549487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.549863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.550291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.551065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:01.551476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:01.553603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac307d-b4b3-48fb-8708-265355017c89 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:01.603179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 853/1706] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:01.603179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc47b8-8a82-4be4-99e8-d5eca01ccfc5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.603179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc47b8-8a82-4be4-99e8-d5eca01ccfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.603179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc47b8-8a82-4be4-99e8-d5eca01ccfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.671919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:01.674513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:01.689192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0afc47b8-8a82-4be4-99e8-d5eca01ccfc5 None None] MFA Rules not processed for user `be489ecec19847829df7c4488986373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:01.690476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0afc47b8-8a82-4be4-99e8-d5eca01ccfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.712646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 854/1707] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:01.713849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:01.734268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d47b8-7d83-431a-9467-b4e9e70a17d5 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:01.748234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.749533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.750062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.750556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.752233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:01.754496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:01.804864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 855/1708] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:01.807270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:01.866162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 854/1709] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:01.876893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.877210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:01.877530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:01.920703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] MFA Rules not processed for user `be489ecec19847829df7c4488986373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:01.921953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:01.972936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67184237-0f65-463e-a62c-c247ba96dd72 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:01.989549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:01.990076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:01.990397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.003332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.005630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.012822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.069609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 855/1710] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:02.084397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 856/1711] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:01 2022] POST /identity/v3/users => generated 303 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:02.085135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.086754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.088552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.104605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849a7-bd3a-45a0-8b37-a1253b6f47d3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.119084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.122852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.123928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.125045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.127054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.133263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76562e8b-3e24-47c4-9b6f-5c40f3daea5a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.168002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 857/1712] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:02.169611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715abc3-c982-488d-bb3f-138dea010929 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.169897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715abc3-c982-488d-bb3f-138dea010929 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.170576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715abc3-c982-488d-bb3f-138dea010929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.206934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:02.214962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7715abc3-c982-488d-bb3f-138dea010929 None None] MFA Rules not processed for user `c11d183b3c0c4b2b83f3b52b881a72cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:02.216654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7715abc3-c982-488d-bb3f-138dea010929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.253651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a098465-3825-4bd3-b543-a5fbfefbda8e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.261664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.262728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.263213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.264064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.278236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.283126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.312707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:02.315121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 856/1713] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:02.316473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.341103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426fb35-3ffd-4c91-9770-dc0b89dffdaa service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.353737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.355594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.357088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.357378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.361005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.362907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.375053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 858/1714] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:02.377153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.377602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.378051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.403552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 857/1715] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:02.404612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.411459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.448946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7c48e-87d1-4327-a0d9-1fa4a3ac6bc9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.451543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] MFA Rules not processed for user `f8b0c96c80db4db4a477a1fa6c1fa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:02.453749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.465157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.468066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.469492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.469889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.490110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.492141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.518245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 858/1716] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:02.519085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.546750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8901ed-5be5-495e-8cbc-d4ababccb85f service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.567628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.568310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.568593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.568870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] PATH_INFO: `/v3/projects/e0af971017c149698d44fb2d1d4fd805/users/0d3020ece63c4d72bebb0182f57c378b/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.602230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0af971017c149698d44fb2d1d4fd805, user_id=0d3020ece63c4d72bebb0182f57c378b, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:02.604907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb2c46-a40e-41b4-95cd-6125c24f4841 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:02.635929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 859/1717] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:02 2022] PUT /identity/v3/projects/e0af971017c149698d44fb2d1d4fd805/users/0d3020ece63c4d72bebb0182f57c378b/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:02.640930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.641222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.641500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:02.655863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 859/1718] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:02.703581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.707731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:02.709108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.742226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dafee-7742-4808-acc7-ca94007d6f58 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:02.834573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 860/1719] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:02.881433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:02.883617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:02.929242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:02.930377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:02.930857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:02.931316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.080178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:03.083564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d87620-6196-409f-b0a8-f5356dc43623 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:03.102805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2c9e-520f-44d7-b587-dea377eed443 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:03.102909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 860/1720] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:03.121408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:03.126953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea199d-8ed0-4377-9db8-a7d09b479290 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.129505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.129845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.130158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.133955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea199d-8ed0-4377-9db8-a7d09b479290 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.135451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea199d-8ed0-4377-9db8-a7d09b479290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.172587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:03.173896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:03.182460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004de2bd-ded2-4855-8d2a-a9768ea31bbd service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:03.253395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 861/1721] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:03.254664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.254947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.255322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.300115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] MFA Rules not processed for user `21e14b8bcd4442168c2d1b7cfc956dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:03.300692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3aea199d-8ed0-4377-9db8-a7d09b479290 None None] MFA Rules not processed for user `ca68ccce2ae54eccbfb1afd171424746`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:03.303664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.304585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3aea199d-8ed0-4377-9db8-a7d09b479290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.427075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:03.484663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 861/1722] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:03.498555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6780a-7868-4838-99e6-b64660ec5fb0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.499115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6780a-7868-4838-99e6-b64660ec5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.499677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6780a-7868-4838-99e6-b64660ec5fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.541857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 862/1723] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:03.543329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d8c6780a-7868-4838-99e6-b64660ec5fb0 None None] MFA Rules not processed for user `ca68ccce2ae54eccbfb1afd171424746`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:03.546044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d8c6780a-7868-4838-99e6-b64660ec5fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.564622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:03.566783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.591879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 862/1724] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:03.616103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd25c42-1d9b-4482-bfd2-d4cfd655aec3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:03.626059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620786-b5fb-4885-888f-7056ab66066f None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.626478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620786-b5fb-4885-888f-7056ab66066f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.627038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2620786-b5fb-4885-888f-7056ab66066f None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.628269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 863/1725] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 17 07:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 07:27:03.632814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:03.633221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.633499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.633769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] PATH_INFO: `/v3/projects/ffec65e760e9482d8611e9bd10500600` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.637523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:03.637819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:03.638106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:03.639001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffec65e760e9482d8611e9bd10500600)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:03.647088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:03.808932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:03.831799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.850843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffec65e760e9482d8611e9bd10500600', 'request_id': 'req-bc4154d9-5692-4b24-a35e-1e97199cf527'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:03.877003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffec65e760e9482d8611e9bd10500600', 'request_id': 'req-bc4154d9-5692-4b24-a35e-1e97199cf527'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:03.903040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffec65e760e9482d8611e9bd10500600', 'request_id': 'req-bc4154d9-5692-4b24-a35e-1e97199cf527'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:03.949433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] The token cache is being invalidate because project ffec65e760e9482d8611e9bd10500600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:03.950399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:03.953033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:03.961586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 863/1726] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:03 2022] DELETE /identity/v3/projects/ffec65e760e9482d8611e9bd10500600 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:03.965811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:03.970522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:03.992903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 864/1727] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:04.023294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:04.024890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:04.043104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7eb1f1-e666-4fb1-bff6-ba861fadb060 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:04.052393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:04.053087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:04.053370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:04.053645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:04.072086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:04.074077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:04.101829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 865/1728] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:04.221627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4154d9-5692-4b24-a35e-1e97199cf527 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:04.247035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:04.247703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:04.247992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:04.248263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] PATH_INFO: `/v3/users/3f3387f0f5724d3a9875f126bb7fedc1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:04.249651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3387f0f5724d3a9875f126bb7fedc1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:04.254452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:04.451886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3387f0f5724d3a9875f126bb7fedc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:04.453588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3387f0f5724d3a9875f126bb7fedc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:04.487121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:04.491791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3387f0f5724d3a9875f126bb7fedc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:04.494747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3387f0f5724d3a9875f126bb7fedc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:04.513921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-091e417d-edb1-42d6-a5b6-6294c2e6fea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3387f0f5724d3a9875f126bb7fedc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:04.549053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 864/1729] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:03 2022] DELETE /identity/v3/users/3f3387f0f5724d3a9875f126bb7fedc1 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:05.169221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:05.172088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.344778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dac89-0c2a-410b-9521-e07ed674530a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.353568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dac89-0c2a-410b-9521-e07ed674530a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.354229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dac89-0c2a-410b-9521-e07ed674530a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.356118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 865/1730] 10.222.0.45 () {54 vars in 912 bytes} [Wed Aug 17 07:27:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:05.371882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2965-fd26-46ca-ab42-73228726496c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.372025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2965-fd26-46ca-ab42-73228726496c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.372307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2965-fd26-46ca-ab42-73228726496c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.374107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 866/1731] 10.222.0.45 () {54 vars in 961 bytes} [Wed Aug 17 07:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:05.381248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c470-df88-4ac2-b33f-93a7c2371a81 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.381813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c470-df88-4ac2-b33f-93a7c2371a81 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.382487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c470-df88-4ac2-b33f-93a7c2371a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.433248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-be56c470-df88-4ac2-b33f-93a7c2371a81 None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:05.435677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-be56c470-df88-4ac2-b33f-93a7c2371a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.440573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909993a5-e453-47bc-a330-61b0dbcf7fb5 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:05.446723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:05.593021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:05.593662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.593941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.597865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.602418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.613264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 867/1732] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Aug 17 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:05.614585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.618711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.619153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.668516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:05.681394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.775148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:05.776850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:05.807042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 866/1733] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:05.807953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:05.848536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 868/1734] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:05.851262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21009e-3e44-45f8-b401-9041b706f38e service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:05.872055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:05.872846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.873205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.873489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:05.876556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.906883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:05.911640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:05.942517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 867/1735] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:05.943724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:05.945990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:05.971333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7bc3f-df7a-4f96-9657-7d191e03ec30 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:05.993119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:05.993760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:05.994069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:05.994343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.017136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.018624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f30b7-407e-4707-b66d-323ddd5408c5 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.040460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 869/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:06.104185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.105954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.265453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.265740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.266066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.324480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c219-7e57-432b-bc26-9f29ee490994 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.328280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] MFA Rules not processed for user `0d3020ece63c4d72bebb0182f57c378b`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:06.332250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.338644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.338644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.338925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.340580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] PATH_INFO: `/v3/projects/213cd2e4122042548beb752ef4482b92` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.344792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=213cd2e4122042548beb752ef4482b92)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.370472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.460539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:06.492061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213cd2e4122042548beb752ef4482b92', 'request_id': 'req-76ca97f5-2072-4b2b-96f4-d8111f934c8a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:06.498796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213cd2e4122042548beb752ef4482b92', 'request_id': 'req-76ca97f5-2072-4b2b-96f4-d8111f934c8a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:06.513582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213cd2e4122042548beb752ef4482b92', 'request_id': 'req-76ca97f5-2072-4b2b-96f4-d8111f934c8a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:06.529646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:06.540002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] The token cache is being invalidate because project 213cd2e4122042548beb752ef4482b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:06.540405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:06.540518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 870/1737] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:06.541282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-76ca97f5-2072-4b2b-96f4-d8111f934c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:06.543352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 868/1738] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:06 2022] DELETE /identity/v3/projects/213cd2e4122042548beb752ef4482b92 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:06.545702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.550413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.550771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9fb75-6d89-419c-b3f7-045f4c1f5709 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.551070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9fb75-6d89-419c-b3f7-045f4c1f5709 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.551351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9fb75-6d89-419c-b3f7-045f4c1f5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.570119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce635cf-57c3-423a-bd61-956fc2c798c6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.599261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-98e9fb75-6d89-419c-b3f7-045f4c1f5709 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:06.600206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-98e9fb75-6d89-419c-b3f7-045f4c1f5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.656257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.657206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.657692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.658088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.658977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.661835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.733228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 871/1739] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:06.738606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.744200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.785800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 869/1740] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:06.787821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.787821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.787821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.832667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:06.834697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:06.851650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 870/1741] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:06.864428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ff48e-7627-4cf2-be57-023fec035cee admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.870878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.871282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.871776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.872059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.872319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.872953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.875302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.888215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc28ba-b375-40a0-a002-30ae1232fcef None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.909701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.911110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.911560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.912441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.913269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:06.913730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.916869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.926012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 872/1742] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:06.931197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.945949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73135-a912-4d54-9b3a-df835d1aa820 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.952898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.953906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.954635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 871/1743] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:06.955125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.955546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.956091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.957111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:06.959430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:06.977788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 873/1744] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:06.981870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:06.982049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffb81-77e8-40d0-af08-98a6e82ab725 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:06.991107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:06.992199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:06.992491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:06.992765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:06.993400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.001232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.039742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb763-f6fd-483d-8392-e803beb47ebe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.065783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.071021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.071442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.071820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] PATH_INFO: `/v3/projects/c6e0b3027e284358950a1b2938fc2f8d/users/49b690e1461a4a95bf266927c4a1cb28/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.104966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 872/1745] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:06 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:07.109101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.109592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e0b3027e284358950a1b2938fc2f8d, user_id=49b690e1461a4a95bf266927c4a1cb28, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.124907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.179019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 874/1746] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:06 2022] PUT /identity/v3/projects/c6e0b3027e284358950a1b2938fc2f8d/users/49b690e1461a4a95bf266927c4a1cb28/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:07.187204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.293478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030102cb-6ad8-464d-a523-693ff3dab6ae admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.338859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:07.360402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:07.382904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.387554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.390961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.391264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.392951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.402998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.411889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7473d9-e2b0-464c-9015-b80d8a39faf3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.423605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.424391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.424796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.425197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.426094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.427922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.453206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 875/1747] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:07.457991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.479407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea29c3-b397-4aad-81ad-752577b392bd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.481653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 873/1748] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:07 2022] POST /identity/v3/users => generated 291 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:07.486574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.494445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.495229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.495615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.495984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] PATH_INFO: `/v3/projects/c6e0b3027e284358950a1b2938fc2f8d/users/49b690e1461a4a95bf266927c4a1cb28/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.504700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e0b3027e284358950a1b2938fc2f8d, user_id=49b690e1461a4a95bf266927c4a1cb28, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.508511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.517601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98db8-c41c-48b8-a652-a32c98b42561 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.528916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.529287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 876/1749] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:07 2022] PUT /identity/v3/projects/c6e0b3027e284358950a1b2938fc2f8d/users/49b690e1461a4a95bf266927c4a1cb28/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:07.533939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.534250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.535622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.536051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.542121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.565713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 874/1750] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:07.569553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.828370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6fe78-c278-4b28-848d-83ea22daef86 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.851874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.852109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.852395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.852679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:07.853468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:07.854992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c228b-e35e-470a-ac47-b42693855732 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:07.887650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 877/1751] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:07.892404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:07.942851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6817e2-1696-440f-9bc6-ee3d2971952f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:07.968214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:07.971890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:07.972204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:07.972488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] PATH_INFO: `/v3/projects/931170d508474014993d320404e52a26/users/9fa42b9c021246f193ff2ea9dcfd8962/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:08.017936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=931170d508474014993d320404e52a26, user_id=9fa42b9c021246f193ff2ea9dcfd8962, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:08.043278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:08.098609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 875/1752] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:07 2022] PUT /identity/v3/projects/931170d508474014993d320404e52a26/users/9fa42b9c021246f193ff2ea9dcfd8962/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:08.111342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103a3b-d64b-4d6a-a9be-c304636d5364 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:08.111631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103a3b-d64b-4d6a-a9be-c304636d5364 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:08.111910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103a3b-d64b-4d6a-a9be-c304636d5364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:08.203917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f7103a3b-d64b-4d6a-a9be-c304636d5364 None None] MFA Rules not processed for user `9fa42b9c021246f193ff2ea9dcfd8962`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:08.205220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f7103a3b-d64b-4d6a-a9be-c304636d5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:08.459011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:08.460193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 878/1753] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:08.669283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a552-b1c5-43ef-b018-38a568f877ea admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:08.683353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:08.683788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:08.683987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:08.690424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:08.691566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:08.691566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:08.691761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:08.693596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:08.708725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:08.744408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] MFA Rules not processed for user `be489ecec19847829df7c4488986373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:08.757306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:08.828078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 876/1754] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:08 2022] POST /identity/v3/projects => generated 381 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:08.832630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:08.879759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:08.911238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 879/1755] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:09.043917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e481e-4b99-48a6-b4d4-fbedcefc6706 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.063670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.064652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.065067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.065479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.066480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:09.068998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:09.097266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:09.106354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 877/1756] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:08 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:09.110473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:09.123400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a529da-379e-4146-826d-0ce94b5bbbaf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.130736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.131849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.132284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.132698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.133569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:09.135537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:09.148501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 880/1757] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:09.152641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:09.173556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0b31-fe27-495a-8cdd-e3a0a27c859f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.187710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.190914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.191448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.191900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] PATH_INFO: `/v3/projects/4c7850b9ceb144cea128ac474cf300e4/users/3669d033b9f049c0baa91888214c6607/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.211315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7850b9ceb144cea128ac474cf300e4, user_id=3669d033b9f049c0baa91888214c6607, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:09.215241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:09.248971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 878/1758] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:09 2022] PUT /identity/v3/projects/4c7850b9ceb144cea128ac474cf300e4/users/3669d033b9f049c0baa91888214c6607/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:09.253872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:09.282472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a261a-1214-4289-a415-f953ea398bd3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.500349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.502024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.503791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.504586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.505597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:09.509488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4300de4-d6c2-4945-a66f-60c47b0f14be admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:09.540712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 881/1759] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:09.542537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:09.564778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fb3cf-0807-4d90-bce3-3232175d7da4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.594921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.595607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.596025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.596123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] PATH_INFO: `/v3/projects/4c7850b9ceb144cea128ac474cf300e4/users/3669d033b9f049c0baa91888214c6607/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.598380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7850b9ceb144cea128ac474cf300e4, user_id=3669d033b9f049c0baa91888214c6607, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:09.601952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:09.619157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 879/1760] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:09 2022] PUT /identity/v3/projects/4c7850b9ceb144cea128ac474cf300e4/users/3669d033b9f049c0baa91888214c6607/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:09.631163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.631906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.632587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:09.691358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] MFA Rules not processed for user `3669d033b9f049c0baa91888214c6607`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:09.693496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:09.832566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 882/1761] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:09.842606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:09.844597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:09.973481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716460a-f0b6-41bd-9a0a-09c7e168ac33 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:09.983407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:09.984116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:09.984397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:09.984673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:10.015639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:10.017447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db3fa-c236-44c8-b4aa-bff55857a44b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:10.029711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 880/1762] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:10.184700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:10.196428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e3f81-f27d-40d1-beda-7f3033f76b05 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:10.201550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:10.202256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:10.203127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:10.203127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:10.273438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:10.274911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68eb59-5c0e-4383-87a1-1aa969292079 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:10.286420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 883/1763] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:11.316309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967749cf-647a-498e-8e80-d1b0b4b6eec8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:11.317646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967749cf-647a-498e-8e80-d1b0b4b6eec8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:11.318109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967749cf-647a-498e-8e80-d1b0b4b6eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:11.443481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:11.444073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:11.444183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:11.452839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-967749cf-647a-498e-8e80-d1b0b4b6eec8 None None] MFA Rules not processed for user `49b690e1461a4a95bf266927c4a1cb28`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:11.457611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:11.458097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-967749cf-647a-498e-8e80-d1b0b4b6eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:11.592240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:11.594551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:11.702884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 881/1764] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:11.708807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:11.708807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:11.708807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:11.867889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 884/1765] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:11.887453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] MFA Rules not processed for user `f8b0c96c80db4db4a477a1fa6c1fa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:11.892845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:12.058659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:12.098136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 882/1766] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:12.269529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:12.271491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:12.608662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca63b8c-7848-43cf-a368-990966570b93 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:12.626108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:12.626686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:12.626973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:12.627249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:12.683961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:12.687449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ddab-d8a5-44d2-a0a2-a8a8b9a8fb3c service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:12.714934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 885/1767] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:27:14.965371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:14.967617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.055319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f738a-f19d-4f38-9972-af5589dc1e5c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:15.060302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:15.060955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.061234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.061636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] PATH_INFO: `/v3/users/5f13a31a5f924fa3b87774a5c4d0195b` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.062781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f13a31a5f924fa3b87774a5c4d0195b)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:15.065754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:15.120065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab9e3-1793-429c-bf16-349529e784a4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.120645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab9e3-1793-429c-bf16-349529e784a4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.120645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ab9e3-1793-429c-bf16-349529e784a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.158998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f13a31a5f924fa3b87774a5c4d0195b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:15.159368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-551ab9e3-1793-429c-bf16-349529e784a4 None None] MFA Rules not processed for user `c11d183b3c0c4b2b83f3b52b881a72cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:15.159676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f13a31a5f924fa3b87774a5c4d0195b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:15.161364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-551ab9e3-1793-429c-bf16-349529e784a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.189244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f13a31a5f924fa3b87774a5c4d0195b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:15.211006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f13a31a5f924fa3b87774a5c4d0195b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:15.223036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-311d5191-5c19-4aa6-b0b8-0c5b12bb8c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f13a31a5f924fa3b87774a5c4d0195b'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:15.231011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 883/1768] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:14 2022] DELETE /identity/v3/users/5f13a31a5f924fa3b87774a5c4d0195b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:15.236124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3bdf-37b2-4849-8173-57893854aacb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.236415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3bdf-37b2-4849-8173-57893854aacb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.237647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb3bdf-37b2-4849-8173-57893854aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.251425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:15.263058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fafb3bdf-37b2-4849-8173-57893854aacb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:15.264311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fafb3bdf-37b2-4849-8173-57893854aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.280088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 886/1769] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:15.435843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 884/1770] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:15.443590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.443964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.444248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.445607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 887/1771] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:15.467089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.467450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.468014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.499592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:15.501456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.524176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:15.582542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:15.584359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.689818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 885/1772] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:15.713460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6ade1-f1b3-4d04-bda5-d8038edd6c62 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:15.718824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:15.725995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.726591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.727069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.746153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:15.747712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:15.760006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 888/1773] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:15.784555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:15.787044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:15.823455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0d12f-2a39-4dde-b335-2b53d76691b4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:15.831804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:15.832468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:15.832700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:15.832967 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:15.847004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:15.850579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:15.865752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 886/1774] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:16.685844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:16.688697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:16.730423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9a571-b45f-4488-969a-4703955a7704 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:16.764695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:16.765854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:16.774331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:16.775088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] PATH_INFO: `/v3/projects/bff8f66c27254c7b8e9150fca909ee1f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:16.779840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff8f66c27254c7b8e9150fca909ee1f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:16.782161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:16.948842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff8f66c27254c7b8e9150fca909ee1f', 'request_id': 'req-9af3a423-f406-4fee-85cb-a157d03b31cd'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:16.962446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff8f66c27254c7b8e9150fca909ee1f', 'request_id': 'req-9af3a423-f406-4fee-85cb-a157d03b31cd'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:16.974445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff8f66c27254c7b8e9150fca909ee1f', 'request_id': 'req-9af3a423-f406-4fee-85cb-a157d03b31cd'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.004400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] The token cache is being invalidate because project bff8f66c27254c7b8e9150fca909ee1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:17.004875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.005785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.009783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 889/1775] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:16 2022] DELETE /identity/v3/projects/bff8f66c27254c7b8e9150fca909ee1f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:17.015823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:17.051263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71a494-8b88-4441-b0c9-e2a36a8da820 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:17.201600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1991-a799-4817-8070-21894319561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:17.202721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1991-a799-4817-8070-21894319561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:17.203166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1991-a799-4817-8070-21894319561b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:17.203601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1991-a799-4817-8070-21894319561b admin admin] PATH_INFO: `/v3/users/085116c3d6cf49f5a035745575aef7b1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:17.206449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df1991-a799-4817-8070-21894319561b admin admin] RBAC: Authorizing `identity:delete_user(user_id=085116c3d6cf49f5a035745575aef7b1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:17.210531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df1991-a799-4817-8070-21894319561b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:17.394246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f8df1991-a799-4817-8070-21894319561b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085116c3d6cf49f5a035745575aef7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.395215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f8df1991-a799-4817-8070-21894319561b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085116c3d6cf49f5a035745575aef7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.428560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f8df1991-a799-4817-8070-21894319561b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085116c3d6cf49f5a035745575aef7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.445844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f8df1991-a799-4817-8070-21894319561b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085116c3d6cf49f5a035745575aef7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.481005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f8df1991-a799-4817-8070-21894319561b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085116c3d6cf49f5a035745575aef7b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.500120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 887/1776] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:17 2022] DELETE /identity/v3/users/085116c3d6cf49f5a035745575aef7b1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:17.531077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:17.533624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:17.565065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3a423-f406-4fee-85cb-a157d03b31cd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:17.659977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:17.660624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:17.660944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:17.773982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:17.774760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:17.775141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:17.775516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] PATH_INFO: `/v3/users/0d3020ece63c4d72bebb0182f57c378b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:17.775912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:17.783920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3020ece63c4d72bebb0182f57c378b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:17.786249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:17.789563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:17.822626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:17.848436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:17.875696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3020ece63c4d72bebb0182f57c378b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.876563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3020ece63c4d72bebb0182f57c378b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.913746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3020ece63c4d72bebb0182f57c378b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.918055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3020ece63c4d72bebb0182f57c378b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.935054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3020ece63c4d72bebb0182f57c378b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:17.968225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 890/1777] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:17 2022] DELETE /identity/v3/users/0d3020ece63c4d72bebb0182f57c378b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:18.089412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 888/1778] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 17 07:27:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:18.135737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:18.137327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:18.251452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:18.253462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:18.292618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8442-fec2-4460-a7e2-b076f0f71b11 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:18.400438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53b04-4cbc-4579-b5d5-8271afc74179 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:18.403724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:18.404495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:18.404844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:18.405117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:18.412422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:18.414158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:18.430182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:18.435275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:18.437707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:18.463999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:18.465510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:18.507832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 891/1779] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:18.508724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:18.518334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:18.543260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 889/1780] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:18.546821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132f4a-277c-4249-9ee2-134c1ac661fc service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:18.574760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:18.575446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:18.575708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:18.575981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:18.595341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:18.597017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:18.624178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 892/1781] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:19.380523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:19.383412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:19.565886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c1242-e253-4c85-aa34-db149947e876 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:19.577692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:19.579207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:19.579665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:19.580093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] PATH_INFO: `/v3/projects/e0af971017c149698d44fb2d1d4fd805` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:19.584534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0af971017c149698d44fb2d1d4fd805)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:19.595586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:19.742925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0af971017c149698d44fb2d1d4fd805', 'request_id': 'req-a23dd294-e8ba-433e-a4c8-10730b07ae31'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:19.767146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0af971017c149698d44fb2d1d4fd805', 'request_id': 'req-a23dd294-e8ba-433e-a4c8-10730b07ae31'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:19.783174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0af971017c149698d44fb2d1d4fd805', 'request_id': 'req-a23dd294-e8ba-433e-a4c8-10730b07ae31'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:19.797027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:19.819393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] The token cache is being invalidate because project e0af971017c149698d44fb2d1d4fd805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:19.819896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:19.820550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:19.822451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 890/1782] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:19 2022] DELETE /identity/v3/projects/e0af971017c149698d44fb2d1d4fd805 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:19.826347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:19.843160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a36d8-10f5-4cdd-9eab-3cf0d705433b service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:19.968012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:19.969001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:19.969466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:19.969889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] PATH_INFO: `/v3/users/49b690e1461a4a95bf266927c4a1cb28` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:19.971597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b690e1461a4a95bf266927c4a1cb28)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:19.973887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:20.019453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:20.053135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b690e1461a4a95bf266927c4a1cb28'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:20.054114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b690e1461a4a95bf266927c4a1cb28'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:20.083911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b690e1461a4a95bf266927c4a1cb28'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:20.089305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b690e1461a4a95bf266927c4a1cb28'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:20.105685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b690e1461a4a95bf266927c4a1cb28'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:20.140790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 893/1783] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:19 2022] DELETE /identity/v3/users/49b690e1461a4a95bf266927c4a1cb28 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:21.031669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:21.034330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:21.061818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dd294-e8ba-433e-a4c8-10730b07ae31 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:21.175686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:21.177266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:21.193150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:21.194062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.194369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.194652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] PATH_INFO: `/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.196153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f065c8c4cedf4c91bf32054391a8a7f1)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:21.198402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:21.301768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f065c8c4cedf4c91bf32054391a8a7f1', 'request_id': 'req-586ff45c-e94f-477d-a635-295387fc3659'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.317686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f065c8c4cedf4c91bf32054391a8a7f1', 'request_id': 'req-586ff45c-e94f-477d-a635-295387fc3659'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.331661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb835a2-6225-4d44-9b26-bdd313e6f6d4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:21.334145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f065c8c4cedf4c91bf32054391a8a7f1', 'request_id': 'req-586ff45c-e94f-477d-a635-295387fc3659'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.385737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] The token cache is being invalidate because project f065c8c4cedf4c91bf32054391a8a7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:21.385737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.385737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-586ff45c-e94f-477d-a635-295387fc3659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.385737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 891/1784] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:21 2022] DELETE /identity/v3/projects/f065c8c4cedf4c91bf32054391a8a7f1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:21.385737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.386267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.386267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.462496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:21.467233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:21.471704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:21.472481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.472953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.473358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] PATH_INFO: `/v3/users/9fa42b9c021246f193ff2ea9dcfd8962` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.476404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa42b9c021246f193ff2ea9dcfd8962)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:21.479670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:21.515447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 892/1785] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:21.517990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:21.521721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:21.537170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af5a5b-0fe7-4c7d-9cad-a35e9d296ff9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:21.544789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:21.545754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.546391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.546961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] PATH_INFO: `/v3/projects/c6e0b3027e284358950a1b2938fc2f8d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.549109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e0b3027e284358950a1b2938fc2f8d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:21.551638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:21.634905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa42b9c021246f193ff2ea9dcfd8962'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.637452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa42b9c021246f193ff2ea9dcfd8962'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.664147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:21.718328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa42b9c021246f193ff2ea9dcfd8962'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.720981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa42b9c021246f193ff2ea9dcfd8962'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.753226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cca5d8ac-ee00-4e25-a562-ff7bfa531073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa42b9c021246f193ff2ea9dcfd8962'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.779348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e0b3027e284358950a1b2938fc2f8d', 'request_id': 'req-14042746-b2b2-4924-b7b9-e990d2bbcab1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.801104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 894/1786] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:21 2022] DELETE /identity/v3/users/9fa42b9c021246f193ff2ea9dcfd8962 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:21.803923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e0b3027e284358950a1b2938fc2f8d', 'request_id': 'req-14042746-b2b2-4924-b7b9-e990d2bbcab1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.807172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48e2b-0264-4942-8d6f-e7c7902924e7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.807613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48e2b-0264-4942-8d6f-e7c7902924e7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.808666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a48e2b-0264-4942-8d6f-e7c7902924e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.815876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e0b3027e284358950a1b2938fc2f8d', 'request_id': 'req-14042746-b2b2-4924-b7b9-e990d2bbcab1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.876888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] The token cache is being invalidate because project c6e0b3027e284358950a1b2938fc2f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:21.877191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.881226 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-14042746-b2b2-4924-b7b9-e990d2bbcab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:21.887328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 893/1787] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:21 2022] DELETE /identity/v3/projects/c6e0b3027e284358950a1b2938fc2f8d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:21.888348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:21.888629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:21.888897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:21.903329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-97a48e2b-0264-4942-8d6f-e7c7902924e7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:21.912874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-97a48e2b-0264-4942-8d6f-e7c7902924e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:21.928954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:21.976259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:21.979253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:22.242448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 895/1788] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:22.244474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b768-7acd-43e1-bd79-4b502c298728 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.245890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b768-7acd-43e1-bd79-4b502c298728 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.246200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b768-7acd-43e1-bd79-4b502c298728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.285678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 894/1789] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:22.285678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.301625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7814b768-7acd-43e1-bd79-4b502c298728 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:22.303022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7814b768-7acd-43e1-bd79-4b502c298728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:22.306414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b149e54-f7bc-45e0-843e-42059350baa8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.316492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.317281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.317554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.317832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.318600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:22.318808 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.320451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.324850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 896/1790] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:22.333861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.334284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.334749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.352700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 895/1791] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:22.352700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.356465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:22.426256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:22.427503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:22.450941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 897/1792] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:22.451867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.462753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f50b9c-9ee6-414e-b85d-770592f75323 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.473149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb9a8d-5495-42c0-aa75-b0a894b337d7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.474545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.475199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.475498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.475756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.488302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.489028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.489272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.489555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.490286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.494918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.496464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.497343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.523924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 896/1793] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:22.524807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.549955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1f54d-fb05-4021-be39-d5603eb3e4d6 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.559496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 898/1794] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:22.561166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.566096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.566769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.567069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.567342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.570938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:22.571360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.573187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.604248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 897/1795] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:22.610081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.630073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316e72b-1e04-4157-a8e1-d1a4eac45f05 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.728376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a62e4-1ef5-418f-92d7-23ae5b7a76f9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.740424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.752281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.753118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.753618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.754527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.756721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.771132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.771798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.772129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.772400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.773144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.775431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:22.811930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 899/1796] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:22.822209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.835525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 898/1797] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:22.838106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:22.846966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8bda-ea59-45cb-911d-6bc420ec5619 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:22.881353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:22.884512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:22.962505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:22.964033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:22.964878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:22.965474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:22.967354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:22.970372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a39055-06e7-4469-a156-4dda389604ae admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.008013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ce5f5-f3f8-4010-9c15-c95d705bab59 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.008557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 900/1798] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:23.017904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e57-5ac4-4694-8d41-534291e59ac8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.019037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e57-5ac4-4694-8d41-534291e59ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.020210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134e57-5ac4-4694-8d41-534291e59ac8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.025491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 901/1799] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:27:23 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:23.026953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134e57-5ac4-4694-8d41-534291e59ac8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.036201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.037091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.037422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.037881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.039273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.044981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.060621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134e57-5ac4-4694-8d41-534291e59ac8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.069130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.069753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.070123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.070501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.071119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.072633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.097556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 902/1800] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:23.104478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.124711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e9a05-cff1-4491-8cf8-179ddf6ad5a5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.133009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 899/1801] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:22 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:23.136473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.141251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.141944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.142265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.142539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] PATH_INFO: `/v3/projects/102f0ae2c214471b9763229e077f1d7f/users/f038f483e9af460189d8929054ce5c75/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.160997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ace7a-5888-44d1-8b67-d0a73fda1edf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.171162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.172034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.172940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.173896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.174712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.178757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.194344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=102f0ae2c214471b9763229e077f1d7f, user_id=f038f483e9af460189d8929054ce5c75, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.205741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 900/1802] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:23.208095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d58729-de28-4161-9467-e49e17d64404 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.210052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.235820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0b67a-1e77-4a2b-ae35-e226ecca4a25 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.249128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 903/1803] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:23 2022] PUT /identity/v3/projects/102f0ae2c214471b9763229e077f1d7f/users/f038f483e9af460189d8929054ce5c75/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:23.265041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f92872-38d0-40a0-b393-2309aff24ddc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.265410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f92872-38d0-40a0-b393-2309aff24ddc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.265605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f92872-38d0-40a0-b393-2309aff24ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.327976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c2f92872-38d0-40a0-b393-2309aff24ddc None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:23.334532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c2f92872-38d0-40a0-b393-2309aff24ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:23.356533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.357165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.358971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.358971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.360487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.363763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6a5c9-19ed-475b-a71d-f3d435cd3628 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.429707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 901/1804] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:23.431625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b82de-c4a1-4d0b-a7e6-370d797ca95b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.436823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b82de-c4a1-4d0b-a7e6-370d797ca95b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.437405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b82de-c4a1-4d0b-a7e6-370d797ca95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.514187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 904/1805] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:23.515482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d21a-2e59-4eb6-891b-e4794bfd8b9e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.518473 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d21a-2e59-4eb6-891b-e4794bfd8b9e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.518910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d21a-2e59-4eb6-891b-e4794bfd8b9e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.522855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b52b82de-c4a1-4d0b-a7e6-370d797ca95b None None] MFA Rules not processed for user `f038f483e9af460189d8929054ce5c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:23.523039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 905/1806] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:27:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:23.523566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b52b82de-c4a1-4d0b-a7e6-370d797ca95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:23.526960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d21a-2e59-4eb6-891b-e4794bfd8b9e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.568748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d21a-2e59-4eb6-891b-e4794bfd8b9e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:23.578372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:23.579189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.579538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.579890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] PATH_INFO: `/v3/projects/edcf76bc8b294ea48cd07d13e28e9c02/users/26a8d5883baa4581ae49bf1900155a8d/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.633287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcf76bc8b294ea48cd07d13e28e9c02, user_id=26a8d5883baa4581ae49bf1900155a8d, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:23.636243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0ce8e-f617-41db-8323-c864ad08ed12 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:23.676478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 906/1807] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:23 2022] PUT /identity/v3/projects/edcf76bc8b294ea48cd07d13e28e9c02/users/26a8d5883baa4581ae49bf1900155a8d/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:23.680848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.687779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.687779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.718467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 902/1808] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:23.718467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:23.718467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:23.718467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:23.743064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:23.745579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:23.759522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:23.774961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] MFA Rules not processed for user `26a8d5883baa4581ae49bf1900155a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:23.777483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:23.820721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:23.917391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 903/1810] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:23.918699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:23.920979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 907/1810] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:23.921945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.006661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154c48e-6867-4cc9-8982-3e5d29ba357e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.011878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.013004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.013209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.013488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.014464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.017085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.070913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 904/1811] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:24.072022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.094780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399c658-bfa6-4296-80ff-22d1001b746e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.233842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f09ba-301b-4fb3-ac48-273de4da37d0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.234089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.234495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.234820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.235076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.235704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.237624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.239796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.240624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.240988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.241363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.243078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.245548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.275204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 908/1812] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:23 2022] POST /identity/v3/projects => generated 371 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:24.276133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.277897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:24.290714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 905/1813] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:24 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:24.291956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.320063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c0b7-9435-466a-b13d-7678d41fb17a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.350981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:24.387001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb892-3639-4067-a7d3-2b0e12f48872 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.400888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.402037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.402329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.402603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.424556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.426193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.460593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.461363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.461711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.463023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.463673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.464258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 909/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:24.465237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.465639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.475883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:24.485010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877ec1-21bd-4489-bf4a-af2f8851a43d service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.506557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.507336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.511398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.513945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.517563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.529029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.533629 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 906/1815] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:24 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:24.540540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.581387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 910/1816] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:24.583092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ee29-c9b1-49f8-a3b6-4e48f86bd0bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.584814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.608102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.609066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.609388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.610324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.611741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.616565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.623220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a8d3d-5a3a-4503-bc0c-82761716c927 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.652555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.653544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.654184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.654516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] PATH_INFO: `/v3/projects/4f21e4916ebd451c8a431565d03455d8/users/66eefed697eb4b588e099337af1be94f/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.682361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 907/1817] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:24.684163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.688484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:24.731008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f21e4916ebd451c8a431565d03455d8, user_id=66eefed697eb4b588e099337af1be94f, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.733624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.746383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4dfa9-4364-4ec2-bcef-269ef2658148 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.758107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.758545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.758853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.759141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.764260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 911/1818] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:24 2022] PUT /identity/v3/projects/4f21e4916ebd451c8a431565d03455d8/users/66eefed697eb4b588e099337af1be94f/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:24.765185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.815655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.823387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.876524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 908/1819] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:24.878233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:24.906492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06457-4cf9-41e2-8700-7698691ae510 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.921305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.922463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.922964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.923443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] PATH_INFO: `/v3/projects/3f362873cd214779afe5d9722ae07d51/users/11e4d28ac347489496ab5baf7054c2c5/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.927669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d663448-cdd1-4e65-a6f3-50d500cc0d1a service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:24.950681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:24.954408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:24.954665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:24.954865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:24.963835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.964789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f362873cd214779afe5d9722ae07d51, user_id=11e4d28ac347489496ab5baf7054c2c5, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:24.967733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.969079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:24.996071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 912/1820] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:24 2022] PUT /identity/v3/projects/3f362873cd214779afe5d9722ae07d51/users/11e4d28ac347489496ab5baf7054c2c5/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:24.999733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:25.018132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 909/1821] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:25.022456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:25.044205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b08c-5c59-4d07-b606-947fc928e18a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:25.196459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a9365-40e0-43f1-a9ea-f2b12ebefadf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:25.204445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:25.205293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:25.205746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:25.206043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] PATH_INFO: `/v3/projects/4f21e4916ebd451c8a431565d03455d8/users/66eefed697eb4b588e099337af1be94f/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:25.208279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f21e4916ebd451c8a431565d03455d8, user_id=66eefed697eb4b588e099337af1be94f, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:25.212877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:25.213476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:25.215774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:25.216138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:25.218323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:25.220028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:25.226913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:25.253715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 913/1822] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:25.256261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:25.262029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:25.275131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 910/1823] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:25 2022] PUT /identity/v3/projects/4f21e4916ebd451c8a431565d03455d8/users/66eefed697eb4b588e099337af1be94f/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:25.276396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:25.335417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0557-4b51-471e-bf53-216d346fb53d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:25.549949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:25.582660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:25.583792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:25.584283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:25.585554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] PATH_INFO: `/v3/projects/931170d508474014993d320404e52a26` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:25.588562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] RBAC: Authorizing `identity:delete_project(project_id=931170d508474014993d320404e52a26)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:25.603376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:25.681426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269757a-c1a7-49cd-b147-80a4ba7176d6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:25.701896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:25.714972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931170d508474014993d320404e52a26', 'request_id': 'req-10521c58-5856-4f3a-b9c6-a73e0d97cdae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:25.726347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931170d508474014993d320404e52a26', 'request_id': 'req-10521c58-5856-4f3a-b9c6-a73e0d97cdae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:25.748247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931170d508474014993d320404e52a26', 'request_id': 'req-10521c58-5856-4f3a-b9c6-a73e0d97cdae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:25.768201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] The token cache is being invalidate because project 931170d508474014993d320404e52a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:25.769760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:25.771971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10521c58-5856-4f3a-b9c6-a73e0d97cdae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:25.775071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 914/1824] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:25 2022] DELETE /identity/v3/projects/931170d508474014993d320404e52a26 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:25.777831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75159a55-773e-416c-9066-2306fb12511e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:25.778418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75159a55-773e-416c-9066-2306fb12511e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:25.779977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75159a55-773e-416c-9066-2306fb12511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:25.857937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:25.858512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:25.858791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:25.859062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] PATH_INFO: `/v3/projects/3f362873cd214779afe5d9722ae07d51/users/11e4d28ac347489496ab5baf7054c2c5/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:25.864650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f362873cd214779afe5d9722ae07d51, user_id=11e4d28ac347489496ab5baf7054c2c5, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:25.868001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:25.924023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-75159a55-773e-416c-9066-2306fb12511e None None] MFA Rules not processed for user `66eefed697eb4b588e099337af1be94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:25.925824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75159a55-773e-416c-9066-2306fb12511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:25.934223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 911/1825] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:25 2022] PUT /identity/v3/projects/3f362873cd214779afe5d9722ae07d51/users/11e4d28ac347489496ab5baf7054c2c5/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:25.935250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:25.938540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:26.175237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1c9ec-fae1-4d40-95a9-ea6270cbd53a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:26.176660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 915/1826] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:26.178449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:26.179812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:26.180319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:26.195340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:26.196467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:26.199142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:26.199770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] PATH_INFO: `/v3/users/3669d033b9f049c0baa91888214c6607` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:26.201735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3669d033b9f049c0baa91888214c6607)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:26.206364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:26.258726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] MFA Rules not processed for user `11e4d28ac347489496ab5baf7054c2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:26.260371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:26.309667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3669d033b9f049c0baa91888214c6607'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:26.310705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3669d033b9f049c0baa91888214c6607'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:26.329048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3669d033b9f049c0baa91888214c6607'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:26.339418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3669d033b9f049c0baa91888214c6607'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:26.354176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3669d033b9f049c0baa91888214c6607'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:26.361355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:26.373189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 912/1827] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:25 2022] DELETE /identity/v3/users/3669d033b9f049c0baa91888214c6607 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:26.374597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:26.380350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:26.413859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 916/1828] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:26.431093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:26.433149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:26.435700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:26.497056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158592-8ea2-455b-9318-b1ce2df848b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:26.502111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:26.503930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:26.504387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:26.504818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:26.507623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:26.597716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:26.599559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:26.619237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e8f6-a284-4620-b313-a11d21df3bd1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:26.630020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 913/1829] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:26.637052 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:26.637831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:26.638145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:26.638417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:26.836169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:26.840646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:26.901982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 917/1830] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:27.068450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:27.081803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9269e1-f5c6-42e8-8a65-7567c2b90a0b service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:27.090253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:27.097293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:27.097293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:27.097293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:27.105647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:27.262360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:27.264087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475ca6-b9d7-4595-bd89-eb11457f3f88 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:27.298303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 914/1831] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:28.307531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:28.310092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:28.442525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8164fd-c71b-4473-972c-6e235ccc832e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:28.452110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:28.454405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:28.455103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:28.455578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] PATH_INFO: `/v3/projects/4c7850b9ceb144cea128ac474cf300e4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:28.457434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7850b9ceb144cea128ac474cf300e4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:28.459655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:28.535943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:28.559159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7850b9ceb144cea128ac474cf300e4', 'request_id': 'req-6632606e-fe9f-4b8d-b571-aa76157426c6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:28.568228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7850b9ceb144cea128ac474cf300e4', 'request_id': 'req-6632606e-fe9f-4b8d-b571-aa76157426c6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:28.597866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7850b9ceb144cea128ac474cf300e4', 'request_id': 'req-6632606e-fe9f-4b8d-b571-aa76157426c6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:28.618723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] The token cache is being invalidate because project 4c7850b9ceb144cea128ac474cf300e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:28.619141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:28.623774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6632606e-fe9f-4b8d-b571-aa76157426c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:28.626554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 918/1832] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:28 2022] DELETE /identity/v3/projects/4c7850b9ceb144cea128ac474cf300e4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:28.631117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:28.631632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:28.631923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:28.663614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:28.667634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:28.760925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 915/1833] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:28.769720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:28.770486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:28.770762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:28.807528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:28.813125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:28.822764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 919/1834] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:28.827309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:28.847641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb742f25-1b97-404f-8279-2e1e44c0acf8 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:28.859496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:28.860685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:28.861010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:28.861323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:28.862059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:28.863779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:28.866165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:28.881727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:28.885488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 916/1835] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:27:28.890524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:28.902926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5490404-c712-4085-9362-2260acc3fc90 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:28.910716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:28.911693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:28.912093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:28.912453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:28.913221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:28.916070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:28.965948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:28.975170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 920/1836] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:28 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:28.979612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a978ff8-8479-441e-96b5-3a72ca2acd89 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.122619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.124284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.124562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.124896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.127761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.133458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.139520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.142163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:29.160739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef205d35-cda0-4493-995f-6bd27dbd009c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.167339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 917/1837] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:28 2022] POST /identity/v3/users => generated 279 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:29.172000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.172720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.172847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.173298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.185420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] PATH_INFO: `/v3/users/f038f483e9af460189d8929054ce5c75` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.187260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f038f483e9af460189d8929054ce5c75)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.189668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.199115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046e53b-4889-4b4c-8349-09db7ac9b0bf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.205892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.208588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.208588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.208588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.208588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.211542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.232840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 918/1838] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:29.234799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.252835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40321f7-55a9-4c25-911d-bafde4d314ba admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.260177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.261169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.261453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.261728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.263001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.265465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.283189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 919/1839] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:29.287754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.304690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f038f483e9af460189d8929054ce5c75'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:29.305485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f038f483e9af460189d8929054ce5c75'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:29.309834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6957c-9619-4eb7-aafe-6cd5b66bc227 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.315418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.316125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.316407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.322679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] PATH_INFO: `/v3/projects/254bb4ca3e02426d85359ff71611ebed/users/c628710b779f4fcbba47bd4fa8d816ed/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.323844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f038f483e9af460189d8929054ce5c75'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:29.325242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f038f483e9af460189d8929054ce5c75'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:29.337346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5817e6e5-2d4c-486c-81ce-de271d4fe03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f038f483e9af460189d8929054ce5c75'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:29.340814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=254bb4ca3e02426d85359ff71611ebed, user_id=c628710b779f4fcbba47bd4fa8d816ed, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.343502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b1f63-016e-4d51-892d-ad4b681fe60e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.358151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 921/1840] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:29 2022] DELETE /identity/v3/users/f038f483e9af460189d8929054ce5c75 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:29.364726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 920/1841] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:29 2022] PUT /identity/v3/projects/254bb4ca3e02426d85359ff71611ebed/users/c628710b779f4fcbba47bd4fa8d816ed/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:29.371649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.372054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.372341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.376375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.376611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.376886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.391976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:29.393182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:29.405569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] MFA Rules not processed for user `c628710b779f4fcbba47bd4fa8d816ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:29.407417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:29.466132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 922/1842] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:29.474341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.475877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:29.482150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 921/1843] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:29.483050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.484402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:29.492286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:29.498946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8ba4a-72dd-4d67-ae19-4fdbcd57f075 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.506153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.507854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.508141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.508482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.509051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.511130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.547535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 922/1844] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:29 2022] POST /identity/v3/projects => generated 357 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:29.549163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.549821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88f8ef-d2f3-4967-9cbe-1424f80145e3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.565258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:29.608855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.609477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.609783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.610265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.627798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d2109-11ce-452f-bba7-a0360c57e860 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.634577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.635526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.635912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.636290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.637041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.640255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.674140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 923/1845] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:29 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:29.677289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.678610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.680044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.692160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18cea1-8603-46ba-9dee-28926bece106 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.693222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 923/1846] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:29.702794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.704199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.704612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.704977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.705949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.707742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.720327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 924/1847] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:29.724846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.737172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7432ff-1302-45bc-8605-e18b87d42357 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.742764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.743611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.743979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.744353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] PATH_INFO: `/v3/projects/14c2428bff2b49b3a9f023eec8d05922/users/a89ea4ffc28d41ccbc8eab3e3e39c71e/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.762866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c2428bff2b49b3a9f023eec8d05922, user_id=a89ea4ffc28d41ccbc8eab3e3e39c71e, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.765866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.785137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 924/1848] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:29 2022] PUT /identity/v3/projects/14c2428bff2b49b3a9f023eec8d05922/users/a89ea4ffc28d41ccbc8eab3e3e39c71e/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:29.789247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.807104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8739849-32c1-440f-bd13-a93338a6712a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.880213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.880831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.881109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.881378 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.882049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.883646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d8703-f6e6-4cf8-a707-d2fb80870c44 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.898895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 925/1849] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:29.902946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:29.916062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e5503-f1ee-4488-8b39-1fb7db19d6ab admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:29.924175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:29.924874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.925214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.926171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] PATH_INFO: `/v3/projects/14c2428bff2b49b3a9f023eec8d05922/users/a89ea4ffc28d41ccbc8eab3e3e39c71e/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.928217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c2428bff2b49b3a9f023eec8d05922, user_id=a89ea4ffc28d41ccbc8eab3e3e39c71e, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:29.931245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:29.947092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 925/1850] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:29 2022] PUT /identity/v3/projects/14c2428bff2b49b3a9f023eec8d05922/users/a89ea4ffc28d41ccbc8eab3e3e39c71e/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:29.957125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:29.957417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:29.957690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:29.987358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] MFA Rules not processed for user `a89ea4ffc28d41ccbc8eab3e3e39c71e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:29.988582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.061284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 926/1851] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:30.073190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:30.074945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.150744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:30.167936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd73c0-8787-42e3-a3b3-8ecbdd359838 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:30.172985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:30.173729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:30.174239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:30.174605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:30.178822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:30.180245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.189510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:30.191482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:30.195547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:30.208059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 926/1852] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:30.273647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cf8d-d610-4af2-94a4-9867de354a58 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:30.283835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:30.285110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:30.285389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:30.285661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] PATH_INFO: `/v3/projects/102f0ae2c214471b9763229e077f1d7f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:30.286850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=102f0ae2c214471b9763229e077f1d7f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:30.288756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:30.354390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:30.356686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.383534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cd01-9d9d-437b-85e4-1c2bd60bbad7 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:30.431375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '102f0ae2c214471b9763229e077f1d7f', 'request_id': 'req-bd12ded6-f83b-4a29-839d-9528aaef00f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.438398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '102f0ae2c214471b9763229e077f1d7f', 'request_id': 'req-bd12ded6-f83b-4a29-839d-9528aaef00f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.448815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '102f0ae2c214471b9763229e077f1d7f', 'request_id': 'req-bd12ded6-f83b-4a29-839d-9528aaef00f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.465999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] The token cache is being invalidate because project 102f0ae2c214471b9763229e077f1d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:30.466296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.467112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.467737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:30.468552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:30.468677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 927/1853] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:30 2022] DELETE /identity/v3/projects/102f0ae2c214471b9763229e077f1d7f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:30.471590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:30.471922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:30.474416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:30.474609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.476805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:30.573310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:30.575131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:30.575417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12ded6-f83b-4a29-839d-9528aaef00f6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:30.582465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:30.583103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:30.583385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:30.583661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] PATH_INFO: `/v3/users/66eefed697eb4b588e099337af1be94f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:30.585080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66eefed697eb4b588e099337af1be94f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:30.587174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:30.588348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 927/1854] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:30.648230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:30.654612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66eefed697eb4b588e099337af1be94f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.655743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66eefed697eb4b588e099337af1be94f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.672026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66eefed697eb4b588e099337af1be94f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.680681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66eefed697eb4b588e099337af1be94f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.694405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0575fc52-c34c-4c1c-995f-cdd8dd27fac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66eefed697eb4b588e099337af1be94f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:30.701998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 928/1855] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:30 2022] DELETE /identity/v3/users/66eefed697eb4b588e099337af1be94f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:31.084468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.095595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8df58-7fee-46bd-9b0c-d7455deb6902 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.174912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.175643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.175990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.176359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] PATH_INFO: `/v3/projects/4f21e4916ebd451c8a431565d03455d8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.177712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f21e4916ebd451c8a431565d03455d8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.179821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.232042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:31.242988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f21e4916ebd451c8a431565d03455d8', 'request_id': 'req-ad4af779-acb9-4bd0-a2d7-16c80421f361'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:31.248665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f21e4916ebd451c8a431565d03455d8', 'request_id': 'req-ad4af779-acb9-4bd0-a2d7-16c80421f361'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:31.258553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f21e4916ebd451c8a431565d03455d8', 'request_id': 'req-ad4af779-acb9-4bd0-a2d7-16c80421f361'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:31.273790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] The token cache is being invalidate because project 4f21e4916ebd451c8a431565d03455d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:31.275015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:31.275700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4af779-acb9-4bd0-a2d7-16c80421f361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:31.278106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 928/1856] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:31 2022] DELETE /identity/v3/projects/4f21e4916ebd451c8a431565d03455d8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:31.283092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.283441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.283912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.306296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:31.307655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:31.372055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 929/1857] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:31.381656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.382152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.382250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.401392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:31.402628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:31.410888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 929/1858] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:31.414934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.425148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22c024-eef8-4a17-b1b7-4a3d97cfe023 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.430061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.430663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.430935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.431201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.431848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:31.432143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.433737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.446067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 930/1859] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:27:31.450437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.459862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53240d4a-ac8b-4e3b-8c5a-e07693be5f88 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.464892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.465488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.465771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.466077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.466709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.468604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.495498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 930/1860] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:31.499546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.510084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcbbe3-9bb3-441b-b1c4-b090feb4018e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.566542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.567152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.567431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.567741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.568309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.570372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.590928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 931/1861] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:31 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:31.595265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.605579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ca2d4-0067-4217-ba7a-c6fdf9d9b142 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.610709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.611316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.611596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.611869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.612544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.614169 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.624435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 931/1862] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:31.628947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.639677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668639f-7017-4b49-b639-a6ba95832668 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.644411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.645020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.645290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.645609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.646363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.647972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d53ca-c637-4a4d-b950-d23124496f40 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.659886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 932/1863] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:31.665126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.676985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d26f8-0073-47ec-8610-ddce229c44c9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.682315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.683074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.683470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.683836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] PATH_INFO: `/v3/projects/66152f9d6f2a45b992b8b2eecf620276/users/4b02e85b2d2a4b04aa7be949e999a5ea/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.710740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66152f9d6f2a45b992b8b2eecf620276, user_id=4b02e85b2d2a4b04aa7be949e999a5ea, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.713413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.732708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 932/1864] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:31 2022] PUT /identity/v3/projects/66152f9d6f2a45b992b8b2eecf620276/users/4b02e85b2d2a4b04aa7be949e999a5ea/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:31.738176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d67f5-7011-4beb-984c-8c5c1bd57b79 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.738458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d67f5-7011-4beb-984c-8c5c1bd57b79 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.738962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d67f5-7011-4beb-984c-8c5c1bd57b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.758243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c79d67f5-7011-4beb-984c-8c5c1bd57b79 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:31.759580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c79d67f5-7011-4beb-984c-8c5c1bd57b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:31.787052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:31.851457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 933/1865] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:31.861704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:31.864654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:31.930303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e3297-648d-49f6-811f-682886556fa6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:31.934268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:31.935869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:31.936313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:31.942885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:31.961590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:31.963427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:31.978423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 933/1866] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:33.054521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.054986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.055193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.089788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] MFA Rules not processed for user `4b02e85b2d2a4b04aa7be949e999a5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:33.095034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:33.177442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 934/1867] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:33.178658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.189942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155a55-a01d-43f2-ac38-3ee24b931f51 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.194796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.195475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.195828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.196209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.196936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.198971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.232117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 934/1868] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:33 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:33.234221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.246159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4e459-06f4-40af-9eac-6b2013fa257f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.310586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.311228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.311507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.311772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.312396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.314988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.339646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 935/1869] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:33 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:33.344883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.357712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d401c9-5ad9-4c00-b9cc-2483f4982708 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.363008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.363621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.363900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.364171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.364823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.368905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.386406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 935/1870] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:33.390599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.428334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4457d-18ac-4f65-b4bf-dbc07243aa76 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.440162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.441147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.441687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.442005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] PATH_INFO: `/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a/users/254230d7170346d9a7e5cf119b28630f/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.477498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7833ac0bc34342b1f7fb8f185e200a, user_id=254230d7170346d9a7e5cf119b28630f, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.481177 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.507039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 936/1871] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:33 2022] PUT /identity/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a/users/254230d7170346d9a7e5cf119b28630f/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:33.511057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.525349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd5cc7-7c3f-4e95-9f26-0fc7aa9bf8c0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.580936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:33.623625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.624483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.624882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.625798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.626731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.628729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681163ec-9673-4f36-a669-c08cfe7026e2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.641185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 936/1872] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:33.645437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:33.658483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fb943-0df8-41b0-984b-00c4cf068424 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:33.665426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:33.666194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:33.667083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:33.667356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] PATH_INFO: `/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a/users/254230d7170346d9a7e5cf119b28630f/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:33.669633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7833ac0bc34342b1f7fb8f185e200a, user_id=254230d7170346d9a7e5cf119b28630f, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:33.673261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:33.685902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 937/1873] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:33 2022] PUT /identity/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a/users/254230d7170346d9a7e5cf119b28630f/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:35.128955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d29ea-8b56-4c4e-a6e0-bf5038756d2c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:35.129495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d29ea-8b56-4c4e-a6e0-bf5038756d2c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:35.129495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d29ea-8b56-4c4e-a6e0-bf5038756d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:35.175585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0f6d29ea-8b56-4c4e-a6e0-bf5038756d2c None None] MFA Rules not processed for user `254230d7170346d9a7e5cf119b28630f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:35.177344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0f6d29ea-8b56-4c4e-a6e0-bf5038756d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:35.329338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 937/1874] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:35.360973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:35.362734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:35.381389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:35.475283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17567-daf8-402a-9d35-1bc688dfb62b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:35.486152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:35.486785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:35.487066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:35.487333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:35.579217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:35.580800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf6c34-2585-4b03-8083-cecf33abb98e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:35.598160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 938/1875] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:36.128685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:36.129150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:36.129150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:36.130822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 938/1876] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:36.147558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:36.148340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:36.148340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:36.172023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:36.173934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:36.246936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 939/1877] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:36.263428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:36.265267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:36.285279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc48404-e8b9-4bf1-81cd-b1208c09adf5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:36.294089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:36.294719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:36.294989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:36.295435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:36.305158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:36.306770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:36.323187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 939/1878] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:37.037758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:37.050457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1ec2-198b-43fa-b1f5-838de5c0772a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:37.056267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:37.061423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:37.061934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:37.062451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:37.073494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:37.075300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f203237-6190-46de-bef9-875d3fd9cd57 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:37.086843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 940/1879] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:46.314295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=54 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:47.081251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=81 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:47.194268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:47.196133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:47.363416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b71334-056c-49f6-bbcc-60f0a023e7af service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:47.380597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:47.381347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:47.384296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:47.384951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] PATH_INFO: `/v3/users/c628710b779f4fcbba47bd4fa8d816ed` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:47.388787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c628710b779f4fcbba47bd4fa8d816ed)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:47.392832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:47.459722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c628710b779f4fcbba47bd4fa8d816ed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:47.461327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c628710b779f4fcbba47bd4fa8d816ed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:47.479630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c628710b779f4fcbba47bd4fa8d816ed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:47.480791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c628710b779f4fcbba47bd4fa8d816ed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:47.491210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c628710b779f4fcbba47bd4fa8d816ed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:47.531572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 940/1880] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:47 2022] DELETE /identity/v3/users/c628710b779f4fcbba47bd4fa8d816ed => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:47.536835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:47.537186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:47.537311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:47.583278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:47.585949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:47.700623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 941/1881] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:47.710978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:47.712564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:47.824580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac3727-b986-4e08-9fe4-f77784bdbc8f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:47.831924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:47.834267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:47.836623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:47.836623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:47.858643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:47.862124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:47.883829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 941/1882] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:48.339156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:48.341266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:48.357561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0a3c0-16a8-40fb-8ffb-96b00162730c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:48.363997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:48.364837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:48.365122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:48.365393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] PATH_INFO: `/v3/projects/254bb4ca3e02426d85359ff71611ebed` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:48.367316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254bb4ca3e02426d85359ff71611ebed)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:48.369411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:48.441523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254bb4ca3e02426d85359ff71611ebed', 'request_id': 'req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.448131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254bb4ca3e02426d85359ff71611ebed', 'request_id': 'req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.459408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254bb4ca3e02426d85359ff71611ebed', 'request_id': 'req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.471661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] The token cache is being invalidate because project 254bb4ca3e02426d85359ff71611ebed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:48.472164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.473031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.475020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 942/1883] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:48 2022] DELETE /identity/v3/projects/254bb4ca3e02426d85359ff71611ebed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:48.478735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:48.492896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5eb159-a175-401e-a718-dbab5ec54d72 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:48.513874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:48.573194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:48.574130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:48.574567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:48.574991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] PATH_INFO: `/v3/users/a89ea4ffc28d41ccbc8eab3e3e39c71e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:48.576312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89ea4ffc28d41ccbc8eab3e3e39c71e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:48.578460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:48.641048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89ea4ffc28d41ccbc8eab3e3e39c71e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.642001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89ea4ffc28d41ccbc8eab3e3e39c71e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.657719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89ea4ffc28d41ccbc8eab3e3e39c71e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.658728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89ea4ffc28d41ccbc8eab3e3e39c71e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.675254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e443062-6b1f-4531-9cf4-e271f5a10ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89ea4ffc28d41ccbc8eab3e3e39c71e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:48.698389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 942/1884] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:48 2022] DELETE /identity/v3/users/a89ea4ffc28d41ccbc8eab3e3e39c71e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:49.095934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.097416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:49.123130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2eb49-7995-4e4d-8540-a73d6e9477d7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.301445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.308720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.309011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.309286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] PATH_INFO: `/v3/projects/14c2428bff2b49b3a9f023eec8d05922` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.310817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c2428bff2b49b3a9f023eec8d05922)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.317750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.379246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:49.412620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c2428bff2b49b3a9f023eec8d05922', 'request_id': 'req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:49.419874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c2428bff2b49b3a9f023eec8d05922', 'request_id': 'req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:49.430468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c2428bff2b49b3a9f023eec8d05922', 'request_id': 'req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:49.446907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] The token cache is being invalidate because project 14c2428bff2b49b3a9f023eec8d05922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:49.447939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:49.448792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e6c5fb87-0bee-4fc9-8aad-46482b7e6467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:49.450868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 943/1885] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:49 2022] DELETE /identity/v3/projects/14c2428bff2b49b3a9f023eec8d05922 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:49.456146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.456283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.456755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.478355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:49.480498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:49.576776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 943/1886] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:49.586478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.586702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.586963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.611603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:49.613013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:49.626301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 944/1887] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:49.630719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.645013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97747397-1f30-4f12-8250-307cd9ed7e01 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.652239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.652974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.653314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.653521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.654221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:49.654526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.656848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.676761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 944/1888] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:49.682196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.692513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477154d6-a769-4032-8f17-abaf2c73cc5e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.710731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.711469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.711950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.712388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.713271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.715889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.747252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 945/1889] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:49 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:49.752115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.762889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a17173-9e53-4f02-8914-f3725e996fbb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.790612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:49.824345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.825047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.825434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.825805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.826575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.829487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.852565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 945/1890] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:49 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:49.856804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.868543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aeee8-e80d-437b-a029-bdafe7f70692 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.873950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.875220 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.875500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.875798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.876478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.878162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.888588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 946/1891] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:49.893267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.904382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473581ba-b278-4ee2-b167-eac356633304 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.911503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.912218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.912496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.912765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.913407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.915034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50c9f-0d6f-4522-aab4-aa1cb24f0475 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.928747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 946/1892] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:49.932836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:49.943684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe83eb-6e68-4cd1-93d6-47c017aca33f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:49.948356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:49.949015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.949297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.949570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] PATH_INFO: `/v3/projects/5dfc5e21bbe14c6094bb6b7e5c4746b5/users/3ed20c7e41794777ae1d3444db710690/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:49.967100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfc5e21bbe14c6094bb6b7e5c4746b5, user_id=3ed20c7e41794777ae1d3444db710690, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:49.969879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:49.986035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 947/1893] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:49 2022] PUT /identity/v3/projects/5dfc5e21bbe14c6094bb6b7e5c4746b5/users/3ed20c7e41794777ae1d3444db710690/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:49.996899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:49.997191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:49.997465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.026467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] MFA Rules not processed for user `3ed20c7e41794777ae1d3444db710690`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:50.027673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:50.095503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 947/1894] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:50.100168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.167451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc14e2-8b9d-4705-aa7a-9993880f4deb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.173281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.174135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.174582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.175017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.175825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.177912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.221655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 948/1895] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:50 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:50.221776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.229912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90673d-b081-4006-83df-9d52a6d8b952 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.285980 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.286599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.286886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.287160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.287780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.289695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.312986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 948/1896] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:50 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:50.316992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.327364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859a42-6783-4731-b5c0-a5da33a9c1bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.332464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.333207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.333510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.333937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.334679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.336367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.351728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 949/1897] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:50.352861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.367506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75a9c-f2fd-4226-a075-be3412d9b16e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.374030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.375373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.375659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.375929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] PATH_INFO: `/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5/users/3e532e8f768142e5b04fed43011e8caa/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.394116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd63dd9b5ae542c5a66826a74ba53cf5, user_id=3e532e8f768142e5b04fed43011e8caa, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.398526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.412945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 949/1898] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:50 2022] PUT /identity/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5/users/3e532e8f768142e5b04fed43011e8caa/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:50.416884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.428667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d5e3-ef99-4a13-acc2-99fd1daaa110 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.448587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:50.489485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.490359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.490645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.490901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.491541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.493400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbfb58-c8f0-428b-ae41-f06643c37cfc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.504562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 950/1899] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:50.508744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.514102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:50.520674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3acd44-5177-44b7-b3e4-2cdd90c4ecb8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.525558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.526225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.526504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.526768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] PATH_INFO: `/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5/users/3e532e8f768142e5b04fed43011e8caa/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.528646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd63dd9b5ae542c5a66826a74ba53cf5, user_id=3e532e8f768142e5b04fed43011e8caa, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.531823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.541778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 950/1900] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:50 2022] PUT /identity/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5/users/3e532e8f768142e5b04fed43011e8caa/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:50.553134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.553419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.553690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.580513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] MFA Rules not processed for user `3e532e8f768142e5b04fed43011e8caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:50.581714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:50.648386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 951/1901] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:50.660165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.661825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:50.718755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf60e-3cd5-4e40-b33b-b284910b80d7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.722431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.723017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.723293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.723561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.732840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.735958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137befd6-bdbf-40ed-8f41-ddb1ea5ed41f service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.747224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 951/1902] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:50.792799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:50.803800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa7581-4cdd-4a9c-9c61-a029d644bd7b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:50.807427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:50.808024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:50.808294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:50.808554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:50.867545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:50.868981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1d235-0071-4512-a4ee-d4ed3ec47e91 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:50.878454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 952/1903] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:51.402871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:51.403157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:51.403444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:51.404786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 952/1904] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:27:51.414099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:51.414385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:51.414656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:51.433591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] MFA Rules not processed for user `5a1acf20f6174d5c91f37c7da6dd9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:51.434812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:51.482203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:51.506403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 953/1905] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:51.518393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:51.521176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:51.553833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48847052-5c00-40ae-bdc9-58ae4cc1cc90 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:51.559280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:51.559912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:51.560183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:51.560447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:51.570537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:51.572094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:51.582920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 953/1906] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:52.009806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:52.011279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:52.074770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062b792-4030-4ac9-8564-ff5dbbc2b24b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:52.079213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:52.079841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:52.080120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:52.080390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] PATH_INFO: `/v3/users/4b02e85b2d2a4b04aa7be949e999a5ea` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:52.081497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b02e85b2d2a4b04aa7be949e999a5ea)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:52.083446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:52.128872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b02e85b2d2a4b04aa7be949e999a5ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.129527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b02e85b2d2a4b04aa7be949e999a5ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.141994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b02e85b2d2a4b04aa7be949e999a5ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.148385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b02e85b2d2a4b04aa7be949e999a5ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.155236 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b02e85b2d2a4b04aa7be949e999a5ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.161534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 954/1907] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:52 2022] DELETE /identity/v3/users/4b02e85b2d2a4b04aa7be949e999a5ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:52.365654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:52.377079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff2115-a523-4e01-b8c3-119b2388a882 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:52.440202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:52.440957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:52.441238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:52.441511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] PATH_INFO: `/v3/projects/66152f9d6f2a45b992b8b2eecf620276` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:52.442704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66152f9d6f2a45b992b8b2eecf620276)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:52.444596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:52.494210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66152f9d6f2a45b992b8b2eecf620276', 'request_id': 'req-0d0f430b-90dd-4d37-8b34-484685d93751'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.501841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66152f9d6f2a45b992b8b2eecf620276', 'request_id': 'req-0d0f430b-90dd-4d37-8b34-484685d93751'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.508735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66152f9d6f2a45b992b8b2eecf620276', 'request_id': 'req-0d0f430b-90dd-4d37-8b34-484685d93751'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.522915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] The token cache is being invalidate because project 66152f9d6f2a45b992b8b2eecf620276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:52.523522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.523874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.528748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 954/1908] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:52 2022] DELETE /identity/v3/projects/66152f9d6f2a45b992b8b2eecf620276 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:52.529876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:52.531888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:52.545050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037062ef-bb6c-44e2-a57a-68cb8b388f61 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:52.623277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:52.623991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:52.624422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:52.624764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] PATH_INFO: `/v3/users/254230d7170346d9a7e5cf119b28630f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:52.626013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254230d7170346d9a7e5cf119b28630f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:52.628142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:52.630254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:52.690113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254230d7170346d9a7e5cf119b28630f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.690764 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254230d7170346d9a7e5cf119b28630f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.703263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254230d7170346d9a7e5cf119b28630f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.710313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254230d7170346d9a7e5cf119b28630f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.717710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4abf1290-bb49-41f5-b89b-ca40d99394f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254230d7170346d9a7e5cf119b28630f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:52.724183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 955/1909] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:52 2022] DELETE /identity/v3/users/254230d7170346d9a7e5cf119b28630f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:52.973363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:52.974860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:52.989555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f430b-90dd-4d37-8b34-484685d93751 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:52.994878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:53.048382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.049003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.049279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.049549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] PATH_INFO: `/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.050656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7833ac0bc34342b1f7fb8f185e200a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.052543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.097905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7833ac0bc34342b1f7fb8f185e200a', 'request_id': 'req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.103715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7833ac0bc34342b1f7fb8f185e200a', 'request_id': 'req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.110844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7833ac0bc34342b1f7fb8f185e200a', 'request_id': 'req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.122227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] The token cache is being invalidate because project 9f7833ac0bc34342b1f7fb8f185e200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:53.122541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.123174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-98d72e52-c6b1-4a2c-a844-e3ce45dad5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.125280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 955/1910] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:52 2022] DELETE /identity/v3/projects/9f7833ac0bc34342b1f7fb8f185e200a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:53.130132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.130418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.130692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.149880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:53.151117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:53.208999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 956/1911] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:53.216650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.216935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.217207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.237450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:53.238685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:53.246894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 956/1912] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:53.251654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.261293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43516df3-9da8-4250-86c9-4f04580a4f66 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.266340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.266935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.267213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.267481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.268123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:53.268419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.270051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.281532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 957/1913] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:53.285606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.294681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e276b6-4d82-4ae7-9b1f-29aa2fc2143d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.299734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.300321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.300600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.300871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.301496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.303414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.331282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 957/1914] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:53.335520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.345503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfef49-dbd4-4ce6-85a2-f262c9ad466f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.404995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.406112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.406396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.406656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.407273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.409175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.419977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:53.434087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 958/1915] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:53.436199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.446245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5116f30-2223-4d3a-a054-80b195a546a3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.450718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.451300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.451595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.451859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.452493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.454074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.463595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 958/1916] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:53.467309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.477661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f57ea-d784-459b-aee9-396042590925 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.482171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.482749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.483019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.483282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.484515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.486105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bde17-8925-4b6a-a3d8-739d084aa7bc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.496554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 959/1917] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:53.500477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.510364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958f4f-0eff-4322-ad79-edb3eb2f44db admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.514857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.515514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.515789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.516055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] PATH_INFO: `/v3/projects/acdaea8701d44f39805cb403d48b718b/users/4f75164614d84c4e82429a41f5757534/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.530413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdaea8701d44f39805cb403d48b718b, user_id=4f75164614d84c4e82429a41f5757534, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.533558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.547702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 959/1918] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:53 2022] PUT /identity/v3/projects/acdaea8701d44f39805cb403d48b718b/users/4f75164614d84c4e82429a41f5757534/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:53.557953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.558440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.558548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.585192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] MFA Rules not processed for user `4f75164614d84c4e82429a41f5757534`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:53.586450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:53.651020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 960/1919] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:53.662710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.664507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:53.707285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:53.728618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711c0e-0279-4645-af69-9470b28e9674 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.732221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.732818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.733091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.733361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.742948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.744409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714ad3-ffc4-4e25-a829-0edd7178f5dd service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.753674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 960/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:53.772952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:53.838669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b212b9-f93e-4eea-9668-97508506b99e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:53.844463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:53.845266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.845543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.845818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] PATH_INFO: `/v3/users/4f75164614d84c4e82429a41f5757534` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.847492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f75164614d84c4e82429a41f5757534)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:53.850123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:53.902848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f75164614d84c4e82429a41f5757534'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.903441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f75164614d84c4e82429a41f5757534'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.917926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f75164614d84c4e82429a41f5757534'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.930881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f75164614d84c4e82429a41f5757534'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.935851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:53.939101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f75164614d84c4e82429a41f5757534'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:53.946237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 961/1921] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:53 2022] DELETE /identity/v3/users/4f75164614d84c4e82429a41f5757534 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:53.950900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:53.951274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:53.951452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:53.972630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:53.973842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.042369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 961/1922] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:54.054034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.055581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.122359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682d30-6a3b-41f4-8716-60b1f447ecf8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.126048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.126677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.126936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.127205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.137135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.138741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da09237-9c0d-46d5-8be5-2a17fca90838 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.150086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 962/1923] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:54.264177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.265629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.277239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0623-06bb-4440-98a5-fd7623d3da0f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.282422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.283049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.283326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.283599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] PATH_INFO: `/v3/users/3ed20c7e41794777ae1d3444db710690` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.284699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed20c7e41794777ae1d3444db710690)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.286657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.349999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed20c7e41794777ae1d3444db710690'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.349999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed20c7e41794777ae1d3444db710690'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.362229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed20c7e41794777ae1d3444db710690'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.362983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed20c7e41794777ae1d3444db710690'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.376463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed20c7e41794777ae1d3444db710690'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.389558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 962/1924] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:54 2022] DELETE /identity/v3/users/3ed20c7e41794777ae1d3444db710690 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:54.393728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.394117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.394460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.417905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:54.419169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.448339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.450132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.495861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 963/1925] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:54.506655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.508006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.511969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:54.527609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3054e-27d6-45c1-8e1c-4490ed94ad7d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.533835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.534614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.534969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.535307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] PATH_INFO: `/v3/projects/acdaea8701d44f39805cb403d48b718b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.536484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdaea8701d44f39805cb403d48b718b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.538437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.566335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604141b4-2a1b-4c7d-8b41-04cfebcd793e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.570531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.571143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.571422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.571690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.581332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.582812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e107c-5842-49f5-a2e6-ee5003003f32 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.586046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdaea8701d44f39805cb403d48b718b', 'request_id': 'req-34beb0e3-40d4-4e17-9872-3e2899de6877'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.591493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdaea8701d44f39805cb403d48b718b', 'request_id': 'req-34beb0e3-40d4-4e17-9872-3e2899de6877'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.592260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 964/1926] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:54.599863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdaea8701d44f39805cb403d48b718b', 'request_id': 'req-34beb0e3-40d4-4e17-9872-3e2899de6877'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.612940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] The token cache is being invalidate because project acdaea8701d44f39805cb403d48b718b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:54.613247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.613921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34beb0e3-40d4-4e17-9872-3e2899de6877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:54.615711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 963/1927] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:54 2022] DELETE /identity/v3/projects/acdaea8701d44f39805cb403d48b718b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:54.620929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.621215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.621491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.648621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:54.650011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.686880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:54.714601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 965/1928] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:54.723622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.723909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.724190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.745360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:54.747146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.755851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 964/1929] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:54.760086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.770338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447f2fa-fb41-4e04-801b-70ec0d262301 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.774946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.775548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.775825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.776095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.776740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:54.777041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.778680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.790958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 966/1930] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:27:54.795530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.804933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475442-f217-4489-aaee-8939d2fbcf30 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.809803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.810449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.810728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.811000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.811719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.813596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.842226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 965/1931] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:54 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:54.847060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.861805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe84da2-122f-4072-9f5a-6eb782120d2b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.868423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.871207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:54.940591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.941209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.941493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.941741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.942428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.944345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.952249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ad290-f48b-4de5-85ef-b45306a0c744 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.957536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.958210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.958515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.958852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] PATH_INFO: `/v3/projects/5dfc5e21bbe14c6094bb6b7e5c4746b5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.959953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfc5e21bbe14c6094bb6b7e5c4746b5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.961858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:54.966986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 967/1932] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:54 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:54.971039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:54.980538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c4fe8-8abf-4479-854b-eb275f6e6c97 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:54.985194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:54.985776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:54.986092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:54.986368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:54.987092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:54.988889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.001207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 968/1933] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:55.005003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.009157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfc5e21bbe14c6094bb6b7e5c4746b5', 'request_id': 'req-9336e038-eb71-4fd4-a707-0d30e750aa23'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.013015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:55.015010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6306f35-26cc-42c2-9d67-9511d528ed8b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.016244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfc5e21bbe14c6094bb6b7e5c4746b5', 'request_id': 'req-9336e038-eb71-4fd4-a707-0d30e750aa23'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.024816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfc5e21bbe14c6094bb6b7e5c4746b5', 'request_id': 'req-9336e038-eb71-4fd4-a707-0d30e750aa23'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.036405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] The token cache is being invalidate because project 5dfc5e21bbe14c6094bb6b7e5c4746b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:55.036690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.037361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.039163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 966/1934] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:54 2022] DELETE /identity/v3/projects/5dfc5e21bbe14c6094bb6b7e5c4746b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:55.042906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.044204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.072278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.072894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.073171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.073442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.074120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.075718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.085947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 969/1935] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:55.089940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.091739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.104149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757d2d-75b4-45f9-a5b1-31404ecd4ba1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.108738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.109363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.109776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.109937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336e038-eb71-4fd4-a707-0d30e750aa23 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.110072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] PATH_INFO: `/v3/projects/e823a7d4fa4646b0a072bd3c54ac547e/users/8ac27600bcca4786b4345a92b066dabd/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.114564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.115179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.115459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.115795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] PATH_INFO: `/v3/users/3e532e8f768142e5b04fed43011e8caa` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.117278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e532e8f768142e5b04fed43011e8caa)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.119223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.125079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e823a7d4fa4646b0a072bd3c54ac547e, user_id=8ac27600bcca4786b4345a92b066dabd, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.127730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c261-ead4-4352-a467-b584e8f34db3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.142162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 970/1936] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:55 2022] PUT /identity/v3/projects/e823a7d4fa4646b0a072bd3c54ac547e/users/8ac27600bcca4786b4345a92b066dabd/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:55.152316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.152892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.152892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.183134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e532e8f768142e5b04fed43011e8caa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.183938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e532e8f768142e5b04fed43011e8caa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.186332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] MFA Rules not processed for user `8ac27600bcca4786b4345a92b066dabd`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:55.187819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.193516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:55.198929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e532e8f768142e5b04fed43011e8caa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.199746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e532e8f768142e5b04fed43011e8caa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.211159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e532e8f768142e5b04fed43011e8caa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.227091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 967/1937] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:55 2022] DELETE /identity/v3/users/3e532e8f768142e5b04fed43011e8caa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:55.271570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 971/1938] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:55.276518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.278210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.360299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f492a-3e4e-4f83-b1b5-ed79ed0dd0a6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.370160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.370160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.370160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.370160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.370575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.370575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.375487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:55.402959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 968/1939] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:55.408181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.474357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185a936-5a82-4ad9-973a-e104c7ff41cb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.529049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.531292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.541872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.542854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.543783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.544130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.544868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.547431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.578264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 972/1940] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:55.579450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.589509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1f5a4-b76b-449a-b3ee-2d358d770676 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.594400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.594992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.595273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.595543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.596181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.597761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.608352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 973/1941] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:55.612946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.620212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68fe06-5407-4e84-81eb-6d54fe81bce0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.623182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424c91-fa9f-45c0-959e-1ecf64ab96c3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.625814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.626476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.626754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.627025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] PATH_INFO: `/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.628130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd63dd9b5ae542c5a66826a74ba53cf5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.628488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.629118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.629399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.629672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] PATH_INFO: `/v3/projects/b7d91db9124948018b59258cf4b8c05f/users/449561b5d19f434c90726640b33716f6/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.630050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.644703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d91db9124948018b59258cf4b8c05f, user_id=449561b5d19f434c90726640b33716f6, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.647425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.661802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 974/1942] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:55 2022] PUT /identity/v3/projects/b7d91db9124948018b59258cf4b8c05f/users/449561b5d19f434c90726640b33716f6/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:55.665626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.675719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:55.677918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd63dd9b5ae542c5a66826a74ba53cf5', 'request_id': 'req-a44bd1eb-a493-499d-b651-dbcb5b536472'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.684094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd63dd9b5ae542c5a66826a74ba53cf5', 'request_id': 'req-a44bd1eb-a493-499d-b651-dbcb5b536472'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.693713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd63dd9b5ae542c5a66826a74ba53cf5', 'request_id': 'req-a44bd1eb-a493-499d-b651-dbcb5b536472'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.704738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] The token cache is being invalidate because project cd63dd9b5ae542c5a66826a74ba53cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:55.704973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.705602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a44bd1eb-a493-499d-b651-dbcb5b536472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:55.707130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 969/1943] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:55 2022] DELETE /identity/v3/projects/cd63dd9b5ae542c5a66826a74ba53cf5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:55.712182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af90d-ad96-42a7-9e1c-6bd9b0b972eb None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.712459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af90d-ad96-42a7-9e1c-6bd9b0b972eb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.712730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07af90d-ad96-42a7-9e1c-6bd9b0b972eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.732106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b07af90d-ad96-42a7-9e1c-6bd9b0b972eb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:55.733296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b07af90d-ad96-42a7-9e1c-6bd9b0b972eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.734490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4c77-2596-4fe2-ae3d-7ab997c3d58c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.789218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.789925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.790232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.790502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.791134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.792706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.792981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 970/1944] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:55.801245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.801551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.801823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.806168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 975/1945] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:55.806932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.808536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.821353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd756c8-265c-4350-babe-dc0167028f14 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.823524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:55.824702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.826106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.826748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.827019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.827427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] PATH_INFO: `/v3/projects/b7d91db9124948018b59258cf4b8c05f/users/449561b5d19f434c90726640b33716f6/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.829297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d91db9124948018b59258cf4b8c05f, user_id=449561b5d19f434c90726640b33716f6, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.831937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8130e-b0ef-4e00-9972-14f3b1c2a81b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.832541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 971/1946] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:55.836565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.842677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 976/1947] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:55 2022] PUT /identity/v3/projects/b7d91db9124948018b59258cf4b8c05f/users/449561b5d19f434c90726640b33716f6/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:55.846862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f03377-b512-4355-8ed1-7e13ace0d2a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.854038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.854280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.854647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.855768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:55.884405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] MFA Rules not processed for user `449561b5d19f434c90726640b33716f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:55.885624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.910669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.911291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.911575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.911846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.912492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:27:55.913202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.914963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.932410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 972/1948] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:27:55.936718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.946362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa77fa-7a6b-4486-8fe5-0461920f5bb3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:55.950904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:55.951486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:55.951767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:55.952035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:55.952680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:55.954616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:55.961995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 977/1949] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:27:55.971097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:55.972480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:55.989500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 973/1950] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:55.990627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.004254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:56.034941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e9bb6-8ae0-4c77-a90c-62afb393538d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.051698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99604a-1b9b-40e4-8e2c-b783b8d3581e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.057037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.057638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.057952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.058607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.058879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.060786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.082657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 974/1951] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:55 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:56.086416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.086749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.087026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.087307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.087575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.089315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:56.096964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9ddd7-64fa-404f-95d1-001f69a15ab6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.101576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.102188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.102474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.102745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.103377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.104944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.116932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 975/1952] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:56.120942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.132511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf81e-2eb1-48c7-bdbe-eb1f00becf7a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.137662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.138326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.138613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.138886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.139522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.141811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.151603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.153036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c88bd-0ddb-4784-8470-26e2971cde04 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.153253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 976/1953] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:56.158087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.163219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 978/1954] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:27:56.169352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536f14-98ec-4053-888e-2bbbd15727d5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.174041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.174678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.174959 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.175229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] PATH_INFO: `/v3/projects/80a41c0c5cd54231b0ebb4153bb330b2/users/d7d679e418604a91afe8b29bb90ba2ce/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.190520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a41c0c5cd54231b0ebb4153bb330b2, user_id=d7d679e418604a91afe8b29bb90ba2ce, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.193502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.207489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 977/1955] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:56 2022] PUT /identity/v3/projects/80a41c0c5cd54231b0ebb4153bb330b2/users/d7d679e418604a91afe8b29bb90ba2ce/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:27:56.218066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.218827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.219096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.246936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] MFA Rules not processed for user `d7d679e418604a91afe8b29bb90ba2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:56.248185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:56.317097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 979/1956] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:56.322021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.355745 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:56.398649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29cd4a-1a5f-4883-80cd-6576476c53c7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.403528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.404000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.404373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.404741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.405476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.408181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.458170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 978/1957] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:27:56 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:27:56.463048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.475636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7f3b9-2554-4505-9e36-811b4bfd83f2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.507892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:56.551488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.552114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.552393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.552664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.553285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.555363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.578515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 980/1958] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:27:56 2022] POST /identity/v3/users => generated 302 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:27:56.582354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.592818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06a29-4823-4d0c-a9ef-cae9f7265956 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.597652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.598390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.599343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.599719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.600464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.602168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.613991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 979/1959] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:27:56.618271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.628841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1895c-9987-4819-a50f-0c7cc98269af admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.633468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.634150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.634429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.634705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] PATH_INFO: `/v3/projects/cf0363788a544c5aaa87119f095752d6/users/e0278f9008b642dbb19e424ddafdcbb7/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.650463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0363788a544c5aaa87119f095752d6, user_id=e0278f9008b642dbb19e424ddafdcbb7, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.653222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.666167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 981/1960] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:56 2022] PUT /identity/v3/projects/cf0363788a544c5aaa87119f095752d6/users/e0278f9008b642dbb19e424ddafdcbb7/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:56.670179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.680223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62591298-9bd0-4548-8c0d-75e3ea7f92ef admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.735770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.736294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.736604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.736878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.737511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.739127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24028b3-8734-4169-950d-669dcf30f106 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.748803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 980/1961] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:27:56.753520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.763929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597af29-bd5f-4a51-994a-25b08e15d188 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.769076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.769720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.770039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.770314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] PATH_INFO: `/v3/projects/cf0363788a544c5aaa87119f095752d6/users/e0278f9008b642dbb19e424ddafdcbb7/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.772203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0363788a544c5aaa87119f095752d6, user_id=e0278f9008b642dbb19e424ddafdcbb7, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.774849 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.784826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 982/1962] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:27:56 2022] PUT /identity/v3/projects/cf0363788a544c5aaa87119f095752d6/users/e0278f9008b642dbb19e424ddafdcbb7/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:56.795609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.795928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.796748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.824354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] MFA Rules not processed for user `e0278f9008b642dbb19e424ddafdcbb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:56.825555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:56.894849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 981/1963] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:56.905461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:56.907191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:56.966511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580b3f0-0602-4e03-886f-aa31d9efefc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:56.970401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:56.971186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:56.971467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:56.971739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:56.981016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:56.982499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:56.993331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 983/1964] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:57.045122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:57.055185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f70cb-9db3-49a5-917c-3606bfef7d6e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:57.058896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:57.059494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:57.059774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:57.060048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:57.079251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:57.121805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:57.123373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e30fbd-c10f-445c-a821-dc9b10bbd2dc service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:57.133809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 982/1965] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:58.795606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:58.881392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820a26-d445-42e1-8c2e-5826b4619d09 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:58.887106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:58.888055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:58.888433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:58.888804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] PATH_INFO: `/v3/users/8ac27600bcca4786b4345a92b066dabd` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:58.890186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac27600bcca4786b4345a92b066dabd)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:58.892406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:58.923881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:58.968367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac27600bcca4786b4345a92b066dabd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:58.969152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac27600bcca4786b4345a92b066dabd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:58.986022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac27600bcca4786b4345a92b066dabd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:58.995382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac27600bcca4786b4345a92b066dabd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.004829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac27600bcca4786b4345a92b066dabd'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.012881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 984/1966] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:58 2022] DELETE /identity/v3/users/8ac27600bcca4786b4345a92b066dabd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:59.018486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:59.018976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:59.019094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:59.038897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:27:59.040092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:59.105460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 983/1967] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:27:59.116585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:59.118455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:59.189029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd48b-681a-4e2a-8d2c-899165e8783f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:59.192865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:59.193640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:59.194001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:59.194345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:59.204186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:59.205624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:59.215554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 985/1968] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:27:59.529781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:59.531963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:27:59.555208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3609404-196a-4cbd-b67d-c1270f1b492e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:59.560858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:59.561645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:59.561927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:59.562300 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] PATH_INFO: `/v3/projects/e823a7d4fa4646b0a072bd3c54ac547e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:59.563487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e823a7d4fa4646b0a072bd3c54ac547e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:59.570835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:59.627363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e823a7d4fa4646b0a072bd3c54ac547e', 'request_id': 'req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.633231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e823a7d4fa4646b0a072bd3c54ac547e', 'request_id': 'req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.641206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e823a7d4fa4646b0a072bd3c54ac547e', 'request_id': 'req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.652265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] The token cache is being invalidate because project e823a7d4fa4646b0a072bd3c54ac547e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:27:59.652539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.653167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.654918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 984/1969] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:27:59 2022] DELETE /identity/v3/projects/e823a7d4fa4646b0a072bd3c54ac547e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:27:59.659216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:27:59.670812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae725d-f453-48a2-b831-d683b1f5fa36 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:27:59.730983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:27:59.731617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:27:59.731898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:27:59.732161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] PATH_INFO: `/v3/users/449561b5d19f434c90726640b33716f6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:27:59.733265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=449561b5d19f434c90726640b33716f6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:27:59.735823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:27:59.779464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:27:59.782884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449561b5d19f434c90726640b33716f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.783966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449561b5d19f434c90726640b33716f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.797814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449561b5d19f434c90726640b33716f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.805020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449561b5d19f434c90726640b33716f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.811984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d540664e-ea5e-46ea-8c96-bcd865f70d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449561b5d19f434c90726640b33716f6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:27:59.818077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 986/1970] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:27:59 2022] DELETE /identity/v3/users/449561b5d19f434c90726640b33716f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:00.170106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.170106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.180703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fe2d5-fb1f-45d1-a41e-5cbb70c7b21a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.228542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:00.246096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.246734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.247014 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.247289 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] PATH_INFO: `/v3/projects/b7d91db9124948018b59258cf4b8c05f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.248402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d91db9124948018b59258cf4b8c05f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.251225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.303648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d91db9124948018b59258cf4b8c05f', 'request_id': 'req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.309812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d91db9124948018b59258cf4b8c05f', 'request_id': 'req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.318075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d91db9124948018b59258cf4b8c05f', 'request_id': 'req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.330855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] The token cache is being invalidate because project b7d91db9124948018b59258cf4b8c05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:00.331151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.331803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dceac4a6-ba49-4c4a-bae4-afb5fcf0f889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.333414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 985/1971] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:00 2022] DELETE /identity/v3/projects/b7d91db9124948018b59258cf4b8c05f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:00.340029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.340288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.340567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.360004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:00.361221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.427042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 987/1972] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:00.435984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.436267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.436535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.458598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:00.459729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.467695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 986/1973] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:00.472151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.482588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10fb7-7b14-4f83-b634-1ad3d8f7b423 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.487411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.488227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.488501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.488766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.489405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:00.489700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.491451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.504104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 988/1974] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:00.508182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.518060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be042540-36a9-435e-9a47-8087be0754d8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.522839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.523424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.523698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.523963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.524651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.526556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.559376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 987/1975] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:00.561146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.572933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dadeb-30af-4111-a8ed-2c46856222a2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.624996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.626732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.632996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.633689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.633980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.634260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.634886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.637072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.661179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 989/1976] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:00.662302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.672381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b91cf-9b4b-4bac-8190-6d1a201bcd0a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.677013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.677699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.678086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.678356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.678983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.680555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.690225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eef05a-6445-44a0-9c8a-bb6823692dcf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.691433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 990/1977] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:00.695222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.695808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.696446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.696728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.697001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] PATH_INFO: `/v3/users/d7d679e418604a91afe8b29bb90ba2ce` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.698223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d679e418604a91afe8b29bb90ba2ce)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.700143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.704817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd89b5-a0ae-478c-9a3d-bd671f4a1ce3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.709617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.710157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.710435 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.710706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.711328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.712900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.722931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 991/1978] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:00.726935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.737122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1110-7ead-4fe1-bdfe-8cede5cefdaa admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.741676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.742593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.742867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.743134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] PATH_INFO: `/v3/projects/afb93daca17c466da3a698536c6b323f/users/b2e79830079c4aa9b95c4622bac45c74/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.751182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d679e418604a91afe8b29bb90ba2ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.751857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d679e418604a91afe8b29bb90ba2ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.753431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:00.755757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:00.760492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb93daca17c466da3a698536c6b323f, user_id=b2e79830079c4aa9b95c4622bac45c74, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.763870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee12a3-c28e-4275-832b-06ce952e2166 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.768251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d679e418604a91afe8b29bb90ba2ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.769347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d679e418604a91afe8b29bb90ba2ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.778324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-956f339c-2d3d-44eb-9b2f-bbe5e0ad351c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d679e418604a91afe8b29bb90ba2ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:00.783359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 992/1979] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:00 2022] PUT /identity/v3/projects/afb93daca17c466da3a698536c6b323f/users/b2e79830079c4aa9b95c4622bac45c74/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:00.788818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.789433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.789719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.795011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 988/1980] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:00 2022] DELETE /identity/v3/users/d7d679e418604a91afe8b29bb90ba2ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:00.800174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.800462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.800737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.812391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:00.812391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.821176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:00.822410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.887301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 993/1981] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:00.897056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.899101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.905149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 989/1982] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:00.920095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:00.922077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:00.976142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeea2fb-5907-4c9b-9671-d095c49f446e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.984687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.984687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.984687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.984687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:00.993620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e44ce-3a43-4512-9724-a16569855835 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:00.994980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:00.996824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:00.997853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:00.998545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:00.998828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:00.999178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:01.007846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 994/1983] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:01.010775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:01.012225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:01.023444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 990/1984] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:28:01.494834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:01.496332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:01.509823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78035055-4fb2-49f8-9e08-4c84c3c2e71a service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:01.516409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:01.517243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:01.517628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:01.518036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] PATH_INFO: `/v3/projects/80a41c0c5cd54231b0ebb4153bb330b2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:01.519640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a41c0c5cd54231b0ebb4153bb330b2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:01.522172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:01.586388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a41c0c5cd54231b0ebb4153bb330b2', 'request_id': 'req-499822d3-86e0-4eee-b526-cf1717bfdd71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.591813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a41c0c5cd54231b0ebb4153bb330b2', 'request_id': 'req-499822d3-86e0-4eee-b526-cf1717bfdd71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.600147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a41c0c5cd54231b0ebb4153bb330b2', 'request_id': 'req-499822d3-86e0-4eee-b526-cf1717bfdd71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.611902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] The token cache is being invalidate because project 80a41c0c5cd54231b0ebb4153bb330b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:01.612193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.612862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.614446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 995/1985] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:01 2022] DELETE /identity/v3/projects/80a41c0c5cd54231b0ebb4153bb330b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:01.618624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:01.628479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda83be2-9b02-4c1d-a210-6a448ca8c20f service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:01.691387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:01.692215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:01.692452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:01.692789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] PATH_INFO: `/v3/users/e0278f9008b642dbb19e424ddafdcbb7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:01.694683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0278f9008b642dbb19e424ddafdcbb7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:01.696966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:01.711873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:01.763240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0278f9008b642dbb19e424ddafdcbb7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.763975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0278f9008b642dbb19e424ddafdcbb7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.780922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0278f9008b642dbb19e424ddafdcbb7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.781821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0278f9008b642dbb19e424ddafdcbb7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.795032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2c3f82da-b3f4-4578-a97a-08554eccb670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0278f9008b642dbb19e424ddafdcbb7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:01.813072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 991/1986] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:01 2022] DELETE /identity/v3/users/e0278f9008b642dbb19e424ddafdcbb7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:02.518734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:02.520879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:02.557424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499822d3-86e0-4eee-b526-cf1717bfdd71 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:02.579491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:02.696438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:02.697574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:02.697951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:02.698396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] PATH_INFO: `/v3/projects/cf0363788a544c5aaa87119f095752d6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:02.700182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0363788a544c5aaa87119f095752d6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:02.704563 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:02.793266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0363788a544c5aaa87119f095752d6', 'request_id': 'req-8280b661-16ca-4894-b24e-6429ff34fe8f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:02.803190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0363788a544c5aaa87119f095752d6', 'request_id': 'req-8280b661-16ca-4894-b24e-6429ff34fe8f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:02.813306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0363788a544c5aaa87119f095752d6', 'request_id': 'req-8280b661-16ca-4894-b24e-6429ff34fe8f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:02.828913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] The token cache is being invalidate because project cf0363788a544c5aaa87119f095752d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:02.829461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:02.830215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8280b661-16ca-4894-b24e-6429ff34fe8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:02.832028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 996/1987] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:02 2022] DELETE /identity/v3/projects/cf0363788a544c5aaa87119f095752d6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:02.836838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:02.837366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:02.837366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:02.865125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:02.867100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:02.953608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 992/1988] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:02.961634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964759-f61a-4f25-a015-4b17d352967d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:02.962582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964759-f61a-4f25-a015-4b17d352967d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:02.963063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964759-f61a-4f25-a015-4b17d352967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:02.991546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-97964759-f61a-4f25-a015-4b17d352967d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:02.993178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-97964759-f61a-4f25-a015-4b17d352967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:03.014531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 997/1989] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:03.024204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.037811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b277a62-6f98-44d9-8b9a-a85a31306f89 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.044329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.045167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.045835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.046240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.047381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:03.047381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.051559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.066006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 993/1990] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:03.070152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964759-f61a-4f25-a015-4b17d352967d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.080737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964759-f61a-4f25-a015-4b17d352967d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.085777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.086682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.086682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.086960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.087577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.089501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.124120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 998/1991] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:03 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:03.124649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.143229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59be59-b6cc-4d38-ab71-9191345543b1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.216626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.217329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.217608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.217909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.218585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.220753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.248385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 994/1992] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:03 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:03.253297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.265088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a76246-82b0-4c5e-9032-a20b8ce2475e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.271173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.271861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.272142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.272413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.273063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.274746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.287238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 999/1993] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:03.290981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.297685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:03.302242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464dd78-4c54-4737-9701-b55c8d585ab9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.310760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.311989 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.312135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.312509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.313483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.315247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c68b5f-eb16-40ed-b39b-7974ca56f715 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.328861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 995/1994] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:03.333483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.354265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1495d0-e87d-4f32-a65c-5e855871aa0e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.359685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.360401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.360797 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.360966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] PATH_INFO: `/v3/projects/3a143c410cb54cac90a2158c24591984/users/80484169a7d64a6592eee2178fe523e0/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.382211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a143c410cb54cac90a2158c24591984, user_id=80484169a7d64a6592eee2178fe523e0, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.385624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.404174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1000/1995] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:03 2022] PUT /identity/v3/projects/3a143c410cb54cac90a2158c24591984/users/80484169a7d64a6592eee2178fe523e0/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:03.415284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f47d-74a5-4f37-8167-1817e60b3288 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.415284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f47d-74a5-4f37-8167-1817e60b3288 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.415512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f47d-74a5-4f37-8167-1817e60b3288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.451639 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e303f47d-74a5-4f37-8167-1817e60b3288 None None] MFA Rules not processed for user `80484169a7d64a6592eee2178fe523e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:03.453053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e303f47d-74a5-4f37-8167-1817e60b3288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:03.550117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 996/1996] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:03.575776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:03.578691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:03.670615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:03.680838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdebbe-b0d6-4b11-9a99-ab8ac00a1438 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:03.685308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:03.685921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:03.686653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:03.687183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:03.698436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:03.699937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:03.711606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1001/1997] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:06.417467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.418084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.418188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.454078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] MFA Rules not processed for user `b2e79830079c4aa9b95c4622bac45c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:06.455306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:06.538042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 997/1998] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:06.539723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:06.541208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:06.619775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c642-5b37-49ec-a7b7-7012519d253c service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:06.625214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:06.625835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.626377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.626601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.627222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:06.629339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:06.675665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:06.694958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1002/1999] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:06 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:06.701889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e3298-f9bd-44e0-9f65-939a046c7492 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:06.778759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:06.779378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.779652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.779970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.780630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:06.782700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:06.809769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 998/2000] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:06 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:06.810981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:06.822501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5e3e2-2716-4234-90d2-d4e559cafcc2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:06.828202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:06.829146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.829422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.829714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.830400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:06.832019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:06.849714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1003/2001] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:06.854666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:06.861802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:06.869432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec6670-e7d9-436d-b217-45555d3acb60 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:06.875889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:06.876763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.877043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.877392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] PATH_INFO: `/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9/users/0ccfbeec090043f1aba4dd16027e20bf/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.893803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c430f9bbb7f746749b5951a3f5f25fb9, user_id=0ccfbeec090043f1aba4dd16027e20bf, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:06.896628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:06.911637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 999/2002] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:06 2022] PUT /identity/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9/users/0ccfbeec090043f1aba4dd16027e20bf/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:06.915851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:06.927246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef072f-1913-46dd-a021-841d9867c72b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:06.988280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:06.988902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:06.989179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:06.989449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:06.990124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:06.992011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:07.003263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1004/2003] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:07.007474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:07.018187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361114-80e2-460a-8852-61028ad21c5f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:07.022770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:07.023425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:07.023696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:07.023961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] PATH_INFO: `/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9/users/0ccfbeec090043f1aba4dd16027e20bf/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:07.025901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c430f9bbb7f746749b5951a3f5f25fb9, user_id=0ccfbeec090043f1aba4dd16027e20bf, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:07.028962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a5cc8-fb21-48e0-9b87-a15c42428506 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:07.044294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1000/2004] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:07 2022] PUT /identity/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9/users/0ccfbeec090043f1aba4dd16027e20bf/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:13.063266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:13.066022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:13.091674 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca990f-51a0-4015-b82f-e5826a4fdba8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:13.251710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:13.263834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:13.264150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:13.265004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:13.265284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] PATH_INFO: `/v3/users/26a8d5883baa4581ae49bf1900155a8d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:13.267157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a8d5883baa4581ae49bf1900155a8d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:13.269132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:13.388200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a8d5883baa4581ae49bf1900155a8d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:13.388909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a8d5883baa4581ae49bf1900155a8d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:13.416059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a8d5883baa4581ae49bf1900155a8d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:13.425085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a8d5883baa4581ae49bf1900155a8d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:13.433437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a8d5883baa4581ae49bf1900155a8d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:13.441371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1005/2005] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:13 2022] DELETE /identity/v3/users/26a8d5883baa4581ae49bf1900155a8d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:13.445577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972f5e-d499-47e5-9e0f-06d62ee9f42d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:13.446094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972f5e-d499-47e5-9e0f-06d62ee9f42d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:13.446182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76972f5e-d499-47e5-9e0f-06d62ee9f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:13.468193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-76972f5e-d499-47e5-9e0f-06d62ee9f42d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:13.469411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-76972f5e-d499-47e5-9e0f-06d62ee9f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:13.569935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1001/2006] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:13.579895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:13.581561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:13.743243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109677c-45ba-4c75-9995-9e77f0cf9db8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:13.752213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:13.752858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:13.753137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:13.753413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:13.766730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:13.768283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:13.779646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1006/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:13.908636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:13.908908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:13.909237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:13.980323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] MFA Rules not processed for user `0ccfbeec090043f1aba4dd16027e20bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:13.981740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:14.140528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1002/2008] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:14.154093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:14.156152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:14.304249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953cca-3ed9-4364-adb8-af28b5732304 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:14.313618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:14.314509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:14.314961 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:14.315411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:14.317552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:14.358038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:14.446828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:14.448955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:14.469208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1007/2009] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:14.679332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:14.681603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:14.712844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa589b2-eb86-4e30-948c-719695465b79 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:14.724829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:14.725506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:14.725787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:14.726109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] PATH_INFO: `/v3/projects/edcf76bc8b294ea48cd07d13e28e9c02` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:14.730874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcf76bc8b294ea48cd07d13e28e9c02)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:14.734552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:14.831604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:14.845835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcf76bc8b294ea48cd07d13e28e9c02', 'request_id': 'req-1688751c-e91d-4715-8dcd-ef5aecef2059'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:14.856641 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcf76bc8b294ea48cd07d13e28e9c02', 'request_id': 'req-1688751c-e91d-4715-8dcd-ef5aecef2059'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:14.872888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcf76bc8b294ea48cd07d13e28e9c02', 'request_id': 'req-1688751c-e91d-4715-8dcd-ef5aecef2059'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:14.892847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] The token cache is being invalidate because project edcf76bc8b294ea48cd07d13e28e9c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:14.893425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:14.894391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:14.896460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1003/2010] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:14 2022] DELETE /identity/v3/projects/edcf76bc8b294ea48cd07d13e28e9c02 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:14.900198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:14.927652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6365c60-1d71-4c6c-bdaf-d1ef8735915c service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:15.020116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:15.021020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:15.021385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:15.021767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] PATH_INFO: `/v3/users/11e4d28ac347489496ab5baf7054c2c5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:15.023048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e4d28ac347489496ab5baf7054c2c5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:15.025627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:15.102868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e4d28ac347489496ab5baf7054c2c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.103660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e4d28ac347489496ab5baf7054c2c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.124646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e4d28ac347489496ab5baf7054c2c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.136510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e4d28ac347489496ab5baf7054c2c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.168929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e4d28ac347489496ab5baf7054c2c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.181651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1008/2011] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:14 2022] DELETE /identity/v3/users/11e4d28ac347489496ab5baf7054c2c5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:15.184791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:15.186548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:15.208848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688751c-e91d-4715-8dcd-ef5aecef2059 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:15.383598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:15.384159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:15.384441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:15.384714 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] PATH_INFO: `/v3/users/ca68ccce2ae54eccbfb1afd171424746` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:15.385887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca68ccce2ae54eccbfb1afd171424746)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:15.387842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:15.472121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca68ccce2ae54eccbfb1afd171424746'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.472786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca68ccce2ae54eccbfb1afd171424746'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.502420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca68ccce2ae54eccbfb1afd171424746'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.504279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca68ccce2ae54eccbfb1afd171424746'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.546860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ed2ddf7-e5c5-4d79-9d83-fe92d8afaebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca68ccce2ae54eccbfb1afd171424746'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.609131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1004/2012] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:15 2022] DELETE /identity/v3/users/ca68ccce2ae54eccbfb1afd171424746 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:15.617786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:15.619616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:15.634307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098cecf-bb2f-47e7-956f-3e358c8c2fcb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:15.696551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:15.730077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:15.731029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:15.731315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:15.731591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] PATH_INFO: `/v3/projects/3f362873cd214779afe5d9722ae07d51` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:15.733512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f362873cd214779afe5d9722ae07d51)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:15.735492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:15.793746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f362873cd214779afe5d9722ae07d51', 'request_id': 'req-bd88936a-6fef-414f-b027-c90ffa8e0d6e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.800833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f362873cd214779afe5d9722ae07d51', 'request_id': 'req-bd88936a-6fef-414f-b027-c90ffa8e0d6e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.809008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f362873cd214779afe5d9722ae07d51', 'request_id': 'req-bd88936a-6fef-414f-b027-c90ffa8e0d6e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.822847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] The token cache is being invalidate because project 3f362873cd214779afe5d9722ae07d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:15.823143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.823966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:15.825984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1009/2013] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:15 2022] DELETE /identity/v3/projects/3f362873cd214779afe5d9722ae07d51 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:15.831264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6294a3-3b9b-4f63-b04b-15ebe6189efa None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:15.831737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6294a3-3b9b-4f63-b04b-15ebe6189efa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:15.831831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6294a3-3b9b-4f63-b04b-15ebe6189efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:15.854195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7c6294a3-3b9b-4f63-b04b-15ebe6189efa None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:15.856258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7c6294a3-3b9b-4f63-b04b-15ebe6189efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:15.916542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:15.923781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:15.925354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:15.941937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1005/2014] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:15.958598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:15.958999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:15.959501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:15.992080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:15.993990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.007002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1006/2015] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:16.009463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.011434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88936a-6fef-414f-b027-c90ffa8e0d6e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.016690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.017655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.018097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.018545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] PATH_INFO: `/v3/projects/2c3f36e86c51479c9bbe844a650ca355` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.020095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3f36e86c51479c9bbe844a650ca355)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.020456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53646326-2a57-4fd4-952a-df3f575f353c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.022865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.025597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.026368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.026717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.027092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.027825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:16.028454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.031538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.054878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1007/2016] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:16.056482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.074387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51086a0e-cb63-41e8-ba52-5e1e1f357d2d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.080681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.081540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.082336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.082616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.083371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.085540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.103494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3f36e86c51479c9bbe844a650ca355', 'request_id': 'req-cb077064-1d78-4e31-94b9-c01181bd4122'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.113126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3f36e86c51479c9bbe844a650ca355', 'request_id': 'req-cb077064-1d78-4e31-94b9-c01181bd4122'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.125348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3f36e86c51479c9bbe844a650ca355', 'request_id': 'req-cb077064-1d78-4e31-94b9-c01181bd4122'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.125608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1008/2017] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:16.128168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:16.130315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.140037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] The token cache is being invalidate because project 2c3f36e86c51479c9bbe844a650ca355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:16.142119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.144267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cb077064-1d78-4e31-94b9-c01181bd4122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.147826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1010/2018] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:15 2022] DELETE /identity/v3/projects/2c3f36e86c51479c9bbe844a650ca355 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:16.153019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102929c-c87a-43df-8c81-4778d3a61160 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.153234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102929c-c87a-43df-8c81-4778d3a61160 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.153503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102929c-c87a-43df-8c81-4778d3a61160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.183393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e102929c-c87a-43df-8c81-4778d3a61160 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:16.185532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e102929c-c87a-43df-8c81-4778d3a61160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.250212 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defd10d-3385-4745-9051-7363cf1b5ae7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.256941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.257661 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.258361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.258668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.259501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.261784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.298135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1011/2019] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:16.300641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.300928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.301199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.346761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1009/2020] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:16.350439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.355787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:16.356370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.360202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.376842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1012/2021] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:16.378999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.392015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd265a-fb8c-460b-8d0e-0532b1096395 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.404391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.405511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.405792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.408559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.410008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:16.410653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.412918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.425443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506fbc3-0bda-4a4d-87bd-0b96cae50a17 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.429538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1013/2022] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:16.430695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.432590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.434938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.435573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.435855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.436167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.438504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.441114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.449837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f36ba-16e4-448b-a958-495f1e82ea95 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.460500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1010/2023] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:16.460500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.466954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.468668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.468951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.469218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] PATH_INFO: `/v3/users/80484169a7d64a6592eee2178fe523e0` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.472746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7ebd5-e5f2-48ed-8c74-f234ea2c2c01 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.473657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80484169a7d64a6592eee2178fe523e0)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.477274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.477782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.478857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.479252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.479780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.480415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.482549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.520748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1011/2024] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:16.522102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.555217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80484169a7d64a6592eee2178fe523e0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.555903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80484169a7d64a6592eee2178fe523e0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.573410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80484169a7d64a6592eee2178fe523e0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.587256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80484169a7d64a6592eee2178fe523e0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.595548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80484169a7d64a6592eee2178fe523e0'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:16.602151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1014/2025] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:16 2022] DELETE /identity/v3/users/80484169a7d64a6592eee2178fe523e0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:16.605575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.605575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.627777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8004-98c9-4680-88f4-932a212f2e48 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.654358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:16.695159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:16.726356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf490-ba1a-4072-877a-8c1fb8ed9e2d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.732691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.734493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.734918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.735324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.736102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.739171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224d914-fff7-47a4-bb83-9a4e0c567fd7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.756719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.757466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.757945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.758383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.759255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.767569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.776491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1015/2026] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:16.778620 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.779097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.779557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.803875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1012/2027] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:16.803875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.815306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:16.817082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.824686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ada773-aed8-4cd1-8a51-df8689c326d3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.827290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1016/2028] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:16.828536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.838711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.842847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.844243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.844243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.844243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.845099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.846952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.861763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c6db-9505-4122-9c98-2bc05989b616 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:16.863835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1013/2029] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:16.869740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.871033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:16.872574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:16.872873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:16.873151 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] PATH_INFO: `/v3/projects/422ce40b8014480ca8e13695c7dc3cf9/users/e629b4b9066e4fdd952378b9ad8f7ef6/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:16.877152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:16.893903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422ce40b8014480ca8e13695c7dc3cf9, user_id=e629b4b9066e4fdd952378b9ad8f7ef6, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:16.896881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:16.918379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1017/2030] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:16 2022] PUT /identity/v3/projects/422ce40b8014480ca8e13695c7dc3cf9/users/e629b4b9066e4fdd952378b9ad8f7ef6/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:16.919343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:16.984295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a785e32-5fc2-420c-b887-a45c8e9a9971 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.014705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ccf07-f3eb-4a61-ba17-35f6477c4ee8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.021241 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.022543 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.022811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.023082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.023750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.025540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7729f81-dec8-4e15-a0d4-3aa4984daa9c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.042428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1018/2031] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:17.043796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.044122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.044398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.073427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.074486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.074957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.075494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.087489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.089077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.091930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] MFA Rules not processed for user `e629b4b9066e4fdd952378b9ad8f7ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:17.094011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:17.102038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1014/2032] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:17.102810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.115072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146e5ea-cf6c-4c1e-9bfb-9c623e9e3184 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.120678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.121463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.121758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.122141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] PATH_INFO: `/v3/projects/385aacb877e14c25b1c8549b0e31fbe7/users/54a7061eb8444109a8991762ce23388e/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.184627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1019/2033] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:17.187702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=385aacb877e14c25b1c8549b0e31fbe7, user_id=54a7061eb8444109a8991762ce23388e, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.189553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.200600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef47f-2ff2-4a70-a39c-2b66daaea95f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.211373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf7a95-3841-4186-99e6-9b4d1cb2e85d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.223152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.224942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.226687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.227562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.229453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.238141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1015/2034] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:17 2022] PUT /identity/v3/projects/385aacb877e14c25b1c8549b0e31fbe7/users/54a7061eb8444109a8991762ce23388e/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:17.238913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.243694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.244401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.244914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.291495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1020/2035] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:17.296357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.303444 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] MFA Rules not processed for user `54a7061eb8444109a8991762ce23388e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:17.305454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:17.328845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:17.345521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:17.434842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff2365-0d19-4143-adca-146d9c3f0e2e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.442073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.442073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.442536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.442966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.444025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.445950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.480793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1021/2036] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:17.485003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.485603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1016/2037] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:17.489865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.505822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d738f1-4364-46c2-a242-41b95a473ea3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.508527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695ab0-05be-4d30-8a0a-61b702181656 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.521276 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.521996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.522214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.522528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.523153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.525332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.526002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.526315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.526590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.527235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.529422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.530640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.551023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1022/2038] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:17.555252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.571711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94941165-8224-4f5c-9d63-4a74971143e6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.586758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1017/2039] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:17.587689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.589885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.590539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.590819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.591094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.591750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.593397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.615765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1023/2040] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:17.623341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.651538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7723-dc0a-4ce2-9b56-d57a818047bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.755546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.756428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.756693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.759357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] PATH_INFO: `/v3/projects/2b5943940ac641f3b64c8a0f20c5bc0a/users/9ea23e8c82924e329fc2d37b184d4e37/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.759614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba17c6-aacd-4883-9d60-44276a117c6c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.777671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.778698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.779115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.779490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.780982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.782769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5943940ac641f3b64c8a0f20c5bc0a, user_id=9ea23e8c82924e329fc2d37b184d4e37, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.785218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7350371-4ce0-4476-8da6-fe9a61aeb347 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.785793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.804229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1024/2041] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:17 2022] PUT /identity/v3/projects/2b5943940ac641f3b64c8a0f20c5bc0a/users/9ea23e8c82924e329fc2d37b184d4e37/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:17.805186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.807204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:17.829812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1018/2042] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:17.831553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.831939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.832768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.872992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] MFA Rules not processed for user `9ea23e8c82924e329fc2d37b184d4e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:17.875752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:17.907298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c65a9-fe70-4590-af6f-3350bdb89e22 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.912331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:17.913038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:17.913318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:17.913595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] PATH_INFO: `/v3/projects/3a143c410cb54cac90a2158c24591984` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:17.914759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a143c410cb54cac90a2158c24591984)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:17.916699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:17.919796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:17.957315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1019/2043] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:17.958267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:17.981474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47acd0-6e5c-4404-aa3c-e9902fca74a6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:17.984052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a143c410cb54cac90a2158c24591984', 'request_id': 'req-cf386c1f-9dca-4fd1-b088-4904aaf493ce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:17.989618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a143c410cb54cac90a2158c24591984', 'request_id': 'req-cf386c1f-9dca-4fd1-b088-4904aaf493ce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:18.000137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a143c410cb54cac90a2158c24591984', 'request_id': 'req-cf386c1f-9dca-4fd1-b088-4904aaf493ce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:18.002947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:18.012519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] The token cache is being invalidate because project 3a143c410cb54cac90a2158c24591984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:18.012807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:18.013456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:18.015055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1025/2044] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:17 2022] DELETE /identity/v3/projects/3a143c410cb54cac90a2158c24591984 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.015787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.017120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.059919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.060595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.061019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.061900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.062881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.064663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855834-e941-41be-91a9-40437b12f164 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.081179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1020/2045] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.081396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.081700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.081953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.104453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386c1f-9dca-4fd1-b088-4904aaf493ce admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.105057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:18.106374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.113129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.115030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.115501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.116368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.119124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.121102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96973818-6c7b-4d13-88c9-41f15ce8e3d1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.126926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1021/2046] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:18.127905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.134527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.147431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cce6a7-81e0-4c61-b7e6-feadd20a8576 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.151205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1026/2047] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:18.152630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.152914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.153188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.155340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.156181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.156454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.156722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] PATH_INFO: `/v3/projects/771c47a876b340cfb339c4b96f531424/users/921f7d52c86b45adb1eb1a7d58d24f40/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.174261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771c47a876b340cfb339c4b96f531424, user_id=921f7d52c86b45adb1eb1a7d58d24f40, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.174434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:18.175625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.176910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.196841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1022/2048] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:18 2022] PUT /identity/v3/projects/771c47a876b340cfb339c4b96f531424/users/921f7d52c86b45adb1eb1a7d58d24f40/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.197887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.251244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1027/2049] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:18.251244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.260275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f2a26-6e42-43d1-bd59-9dd870155ddf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.275776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:18.286785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e7cdb-0e71-4902-869d-68abd700d023 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.292396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.293143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.293491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.294893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.295945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.298214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.369886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1023/2050] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:18.369886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.382303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb86cfb-4efb-4f38-902c-957039207601 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.387296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.387937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.388222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.388494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.389160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.389295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:18.389472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.389898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.390347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.390838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.391100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.391746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.393502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.405738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1024/2051] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:18.406060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1028/2052] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.406634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.410493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.417051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7dad-6eba-408c-81db-533cf164088c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.423122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04423d-a507-46c8-ac44-174a44c91f92 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.424001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.425176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.425392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.425658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.426331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.428361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.428500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.429011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.429289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.429556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.430322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.432234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.444303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1025/2053] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.444303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.457925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981045-3453-42b0-bb59-7984924ffd0d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.461743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1029/2054] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:18.462640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.466571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.467780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.468043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.468313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] PATH_INFO: `/v3/projects/771c47a876b340cfb339c4b96f531424/users/921f7d52c86b45adb1eb1a7d58d24f40/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.470348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771c47a876b340cfb339c4b96f531424, user_id=921f7d52c86b45adb1eb1a7d58d24f40, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.472905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.484313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1026/2055] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:18 2022] PUT /identity/v3/projects/771c47a876b340cfb339c4b96f531424/users/921f7d52c86b45adb1eb1a7d58d24f40/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.495114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.546714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fc73-799c-4f47-a845-7c253eccdbb5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.554135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:18.578396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8f1e-591f-4faf-9218-7e5c8781fa33 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.584952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.585132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.585347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.585616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.586268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.588234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff548b-2380-4f29-88f6-050a297b8ff7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.609739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.610152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1027/2056] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:18.610504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.610779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.611075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] PATH_INFO: `/v3/projects/35aabdd6e20041049499a60bae9b723e/users/34c351e966fa4bbd86064fa9dab1aad0/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.611386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.611852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.612082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.626426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aabdd6e20041049499a60bae9b723e, user_id=34c351e966fa4bbd86064fa9dab1aad0, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.629255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.641286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] MFA Rules not processed for user `921f7d52c86b45adb1eb1a7d58d24f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:18.642765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.643936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1030/2057] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:18 2022] PUT /identity/v3/projects/35aabdd6e20041049499a60bae9b723e/users/34c351e966fa4bbd86064fa9dab1aad0/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.647891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.672578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:18.710422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ec0d-3342-4915-b324-1c9efff264d9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.715138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1028/2058] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:18.715138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.721086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.721702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.722011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.722451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.722601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2292f4-4ecd-432d-b8d2-b8641d8f6776 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.723020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.724623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.727227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.727813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.728199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.728474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.729105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.730706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.734864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1031/2059] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.735666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.737343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.741651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1029/2060] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.742767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.752393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc09d-0bf4-4aed-b661-ac7e225c5ce4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.757070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.757642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.757918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.758221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.758878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.760469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.773825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1030/2061] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:18.773825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.786098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd749f1-6251-4d4f-9cdf-b212dcdf4513 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.792341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.793089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.793439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.793784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] PATH_INFO: `/v3/projects/35aabdd6e20041049499a60bae9b723e/users/34c351e966fa4bbd86064fa9dab1aad0/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.796193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35aabdd6e20041049499a60bae9b723e, user_id=34c351e966fa4bbd86064fa9dab1aad0, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.800160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.804793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7ccff-aeb3-40d8-b9d1-0af349c14ca2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.809408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.810169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.810448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.810721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.815666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1031/2062] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:18 2022] PUT /identity/v3/projects/35aabdd6e20041049499a60bae9b723e/users/34c351e966fa4bbd86064fa9dab1aad0/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.818617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.830807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.832883 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34361f-210c-4c40-baad-5326918b8c89 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.845099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1032/2063] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:18.846779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0028cd-b668-4754-b4cd-8420789c4ecf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.847073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0028cd-b668-4754-b4cd-8420789c4ecf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.847577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0028cd-b668-4754-b4cd-8420789c4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.890047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9c0028cd-b668-4754-b4cd-8420789c4ecf None None] MFA Rules not processed for user `34c351e966fa4bbd86064fa9dab1aad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:18.891284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9c0028cd-b668-4754-b4cd-8420789c4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:18.895797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd855-ed6b-4fe1-b89a-4c104ab451b4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:18.902460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:18.903287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:18.903567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:18.903838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] PATH_INFO: `/v3/projects/800109ada59444ab9c20bc533a656a62/users/ef6eb70a515d4ca3a1ece69250473276/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:18.919532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800109ada59444ab9c20bc533a656a62, user_id=ef6eb70a515d4ca3a1ece69250473276, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:18.922279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:18.944920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1032/2064] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:18 2022] PUT /identity/v3/projects/800109ada59444ab9c20bc533a656a62/users/ef6eb70a515d4ca3a1ece69250473276/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:18.946218 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:18.953504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:19.018759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1033/2065] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:19.020587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.021140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.021413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.028985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ddfdb-9297-4555-82be-c9b366f03138 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:19.034159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:19.034788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.035477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.035477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] PATH_INFO: `/v3/users/54a7061eb8444109a8991762ce23388e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.036486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a7061eb8444109a8991762ce23388e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:19.038466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:19.061463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] MFA Rules not processed for user `ef6eb70a515d4ca3a1ece69250473276`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:19.062821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.100326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:19.115095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a7061eb8444109a8991762ce23388e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:19.115855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a7061eb8444109a8991762ce23388e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:19.131098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a7061eb8444109a8991762ce23388e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:19.132506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a7061eb8444109a8991762ce23388e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:19.144536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a7061eb8444109a8991762ce23388e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:19.153585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1034/2066] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:19.154570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:19.182962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1033/2067] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:18 2022] DELETE /identity/v3/users/54a7061eb8444109a8991762ce23388e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:19.184128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:19.189825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.231400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1bb48-33a5-4a64-a28c-1fa80bd8f905 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:19.273476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfc45a-8d6e-4efd-9bfb-622dd8d3a681 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:19.277573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:19.278244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.278527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.278797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.281089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.297767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:19.298507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.298811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.299025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.300858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.318419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:19.355041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:19.356526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51ca0-2030-45d4-9198-2a85f1064296 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:19.369658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1034/2068] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:19.371176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.371687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.372023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.393636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:19.393886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:19.395304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.395899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:19.419737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1035/2069] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:19.482117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1035/2070] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:19.493181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:19.494682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.533181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:19.534803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.554501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef8e5-f81f-49f0-a36e-edc2dc767256 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:19.557704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:19.563121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:19.564442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.564606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.564823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.568170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:19.572992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e730c9-d3db-40d8-a74f-241f57df1297 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:19.578234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:19.579389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:19.579924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:19.580444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:19.591862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:19.593481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:19.604695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1036/2071] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:19.649582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:19.651712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:19.674909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1036/2072] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:28:19.981020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:19.982627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:20.006348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d77a-5986-4b1a-82bd-6847fa302774 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:20.012423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:20.012958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.013348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.013661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] PATH_INFO: `/v3/projects/385aacb877e14c25b1c8549b0e31fbe7` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.015558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=385aacb877e14c25b1c8549b0e31fbe7)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:20.018041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:20.086008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385aacb877e14c25b1c8549b0e31fbe7', 'request_id': 'req-25287d71-8ce7-4204-9c23-b36ddb22dd5d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.091472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385aacb877e14c25b1c8549b0e31fbe7', 'request_id': 'req-25287d71-8ce7-4204-9c23-b36ddb22dd5d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.099305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385aacb877e14c25b1c8549b0e31fbe7', 'request_id': 'req-25287d71-8ce7-4204-9c23-b36ddb22dd5d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.111534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] The token cache is being invalidate because project 385aacb877e14c25b1c8549b0e31fbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:20.111826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.112567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.114368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1037/2073] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:19 2022] DELETE /identity/v3/projects/385aacb877e14c25b1c8549b0e31fbe7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:20.118324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:20.129919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed191c-84ea-4ebf-9128-4c1890e1efad service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:20.192458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:20.193093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.193497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.193782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] PATH_INFO: `/v3/users/921f7d52c86b45adb1eb1a7d58d24f40` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.194998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=921f7d52c86b45adb1eb1a7d58d24f40)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:20.196998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:20.215254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:20.253594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921f7d52c86b45adb1eb1a7d58d24f40'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.254470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921f7d52c86b45adb1eb1a7d58d24f40'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.267939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921f7d52c86b45adb1eb1a7d58d24f40'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.268676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921f7d52c86b45adb1eb1a7d58d24f40'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.278004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6220bf47-e1e8-4959-a030-6bb4255ca345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921f7d52c86b45adb1eb1a7d58d24f40'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.317157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1037/2074] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:20 2022] DELETE /identity/v3/users/921f7d52c86b45adb1eb1a7d58d24f40 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:20.617096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:20.619473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:20.642488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25287d71-8ce7-4204-9c23-b36ddb22dd5d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:20.699377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:20.700004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.700279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.700550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] PATH_INFO: `/v3/projects/771c47a876b340cfb339c4b96f531424` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.702301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771c47a876b340cfb339c4b96f531424)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:20.704214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:20.749580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771c47a876b340cfb339c4b96f531424', 'request_id': 'req-1a496d57-2f23-49c4-9038-a5e56ebd6e80'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.755113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771c47a876b340cfb339c4b96f531424', 'request_id': 'req-1a496d57-2f23-49c4-9038-a5e56ebd6e80'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.761819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771c47a876b340cfb339c4b96f531424', 'request_id': 'req-1a496d57-2f23-49c4-9038-a5e56ebd6e80'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.769309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:20.774544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] The token cache is being invalidate because project 771c47a876b340cfb339c4b96f531424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:20.775037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.776074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1a496d57-2f23-49c4-9038-a5e56ebd6e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:20.777707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1038/2075] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:20 2022] DELETE /identity/v3/projects/771c47a876b340cfb339c4b96f531424 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:20.783465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.783687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.783960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.803492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:20.804677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:20.866334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1038/2076] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:20.876161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.876450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.876721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.895960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:20.897149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:20.904988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1039/2077] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:20.909758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:20.921225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eef81-1861-4f8b-886c-4871a0028953 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:20.926399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:20.927067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.927341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.927605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.928241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:20.928593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:20.930209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:20.952058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1039/2078] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:28:20.953761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:20.966163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9506b19-4745-4afe-ac08-d9bb4639d00c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:20.975172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:20.975888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:20.976158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:20.976447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:20.977068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:20.979208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.011705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1040/2079] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:21.015824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.031355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65583-b3d2-4638-beba-f8544507a040 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.089431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.090074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.090351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.090656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.091288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.093254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.115653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1040/2080] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:21 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:21.120893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.135099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d8016-301a-4788-bfc6-29eaa0db6206 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.139766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.140389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.141037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.141300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.141940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.143619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.165700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1041/2081] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:21.169667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.185153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28405-159a-44e8-a6b1-ff4708cacef9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.191747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.192323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.193016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.193016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.193528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.195135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce4ef-acd3-4fbc-b568-610b4bea94d5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.204290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:21.211475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1041/2082] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:21.215404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.228822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe84e1-c8d4-424b-a60c-f79165b91fc3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.236829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.237616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.237895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.238191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] PATH_INFO: `/v3/projects/0ed40744fa2d4532bb7899c62148cc14/users/99f7714369394024a57887c13f15e9db/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.265633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed40744fa2d4532bb7899c62148cc14, user_id=99f7714369394024a57887c13f15e9db, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.270504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.298230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1042/2083] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:21 2022] PUT /identity/v3/projects/0ed40744fa2d4532bb7899c62148cc14/users/99f7714369394024a57887c13f15e9db/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:21.308518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.308798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.309235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.340593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] MFA Rules not processed for user `99f7714369394024a57887c13f15e9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:21.341985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:21.422294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1042/2084] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:21.427001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.511900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ba8b-5f7b-4ea2-9c3c-e9b4b8f07eb8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.519208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.520175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.520777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.521253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.522330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.525642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.581572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1043/2085] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:21 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:21.583516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.599420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b1d86-4b3b-4b37-8c8f-e64db75ab25b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.681710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.682380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.682659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.682928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.683549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.685535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.716145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1043/2086] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:21 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:21.720779 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.731204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d76704-ec78-408a-afb7-5c352b421a54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.736203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.736786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.737061 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.737332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.737987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.739559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.754549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1044/2087] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:21.755671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.766405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d2599-b2e8-4148-a10b-75b53d392830 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.771022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.771670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.771944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.772213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] PATH_INFO: `/v3/projects/e2605a1174d84bd899cfba4a68b93f00/users/64edfd738cb6480eb3766f43b0f68747/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.787147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2605a1174d84bd899cfba4a68b93f00, user_id=64edfd738cb6480eb3766f43b0f68747, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.789771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.804770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1044/2088] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:21 2022] PUT /identity/v3/projects/e2605a1174d84bd899cfba4a68b93f00/users/64edfd738cb6480eb3766f43b0f68747/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:21.808940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.819759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d6bb-f031-4555-990b-55c4ad54a6a9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.880445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.881056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.881380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.881606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.882305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.883957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4245-2492-4b6e-9590-d9ae2e714cc1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.894384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1045/2089] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:21.898844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:21.910161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d33b2f-7883-47f6-9839-6300ee71d782 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:21.915613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:21.916522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.916944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.917220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] PATH_INFO: `/v3/projects/e2605a1174d84bd899cfba4a68b93f00/users/64edfd738cb6480eb3766f43b0f68747/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.919166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2605a1174d84bd899cfba4a68b93f00, user_id=64edfd738cb6480eb3766f43b0f68747, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:21.922153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:21.934341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1045/2090] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:21 2022] PUT /identity/v3/projects/e2605a1174d84bd899cfba4a68b93f00/users/64edfd738cb6480eb3766f43b0f68747/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:21.946436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:21.946722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:21.946999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:21.955742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:21.976672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] MFA Rules not processed for user `64edfd738cb6480eb3766f43b0f68747`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:21.977893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.047783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1046/2091] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:22.058330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:22.059934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.106101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:22.117949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df4ddc-e64c-415f-b6f7-091edec4044f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:22.121587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:22.122210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:22.122482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:22.122747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:22.176394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:22.177806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:22.187310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1046/2092] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:22.643776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:22.645212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.721160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e25a86-1359-450c-a8e2-ac4b36b8cfa4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:22.728302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:22.728941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:22.729214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:22.729482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] PATH_INFO: `/v3/users/ef6eb70a515d4ca3a1ece69250473276` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:22.730622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6eb70a515d4ca3a1ece69250473276)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:22.733886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:22.796148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6eb70a515d4ca3a1ece69250473276'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.796995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6eb70a515d4ca3a1ece69250473276'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.801470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:22.802996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.811921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6eb70a515d4ca3a1ece69250473276'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.819219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f052c-aa6b-4e43-8cc6-28733f6a44a5 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:22.820287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6eb70a515d4ca3a1ece69250473276'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.824077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:22.824709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:22.824983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:22.825362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] PATH_INFO: `/v3/users/e629b4b9066e4fdd952378b9ad8f7ef6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:22.826528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e629b4b9066e4fdd952378b9ad8f7ef6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:22.828339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-28748c04-1ab2-4cdc-9003-27069e00fff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6eb70a515d4ca3a1ece69250473276'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.828602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:22.838182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1047/2093] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:22 2022] DELETE /identity/v3/users/ef6eb70a515d4ca3a1ece69250473276 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:22.840110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:22.840110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:22.840331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:22.865919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:22.867547 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.873158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:22.900927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e629b4b9066e4fdd952378b9ad8f7ef6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.901870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e629b4b9066e4fdd952378b9ad8f7ef6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.915065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e629b4b9066e4fdd952378b9ad8f7ef6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.915869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e629b4b9066e4fdd952378b9ad8f7ef6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.923534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-71415976-186c-4c86-8bbc-a2a45004d6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e629b4b9066e4fdd952378b9ad8f7ef6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:22.936526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1047/2094] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:22 2022] DELETE /identity/v3/users/e629b4b9066e4fdd952378b9ad8f7ef6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:22.938499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1048/2095] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:22.940795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:22.941081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:22.941351 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:22.948134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:22.949564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:22.960313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:22.961505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.019722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e09c2f-e90c-4aed-b18c-25a108a75a7b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.029241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1048/2096] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:23.039498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.049953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:23.071516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.072116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.072387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.072652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.082209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.083566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.093645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1049/2097] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:23.097299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc415f-9c23-4b39-bb35-4aa71ffe568e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.100982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.101657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.101941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.102259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.111518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.112942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.122812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1049/2098] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:28:23.442372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.444173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.463900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6e7da-b87c-4362-80f9-fd2f2d148678 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.469557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.469746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.470050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.470327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] PATH_INFO: `/v3/projects/800109ada59444ab9c20bc533a656a62` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.471623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=800109ada59444ab9c20bc533a656a62)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.473598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.510276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.511865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.528229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803dbb5-7fa0-4413-aab3-d32d641c4399 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.536328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800109ada59444ab9c20bc533a656a62', 'request_id': 'req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.543834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800109ada59444ab9c20bc533a656a62', 'request_id': 'req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.548251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:23.553404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800109ada59444ab9c20bc533a656a62', 'request_id': 'req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.568129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] The token cache is being invalidate because project 800109ada59444ab9c20bc533a656a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:23.568415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.569073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1f7bd00-de89-49d2-8b99-9fd991b9e1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.570609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1050/2099] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:23 2022] DELETE /identity/v3/projects/800109ada59444ab9c20bc533a656a62 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:23.578922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c66d-88eb-4470-8d30-454167c3b38a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.579206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c66d-88eb-4470-8d30-454167c3b38a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.579470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247c66d-88eb-4470-8d30-454167c3b38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.591000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.591695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.591920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.592226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] PATH_INFO: `/v3/projects/422ce40b8014480ca8e13695c7dc3cf9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.593343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=422ce40b8014480ca8e13695c7dc3cf9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.595413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.599702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f247c66d-88eb-4470-8d30-454167c3b38a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:23.600895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f247c66d-88eb-4470-8d30-454167c3b38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.610049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1051/2100] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:23.626144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.626144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.626144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.641417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:23.642659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.655269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422ce40b8014480ca8e13695c7dc3cf9', 'request_id': 'req-5a25eada-c0ec-4594-a25e-a357577f4e06'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.662214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422ce40b8014480ca8e13695c7dc3cf9', 'request_id': 'req-5a25eada-c0ec-4594-a25e-a357577f4e06'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.672029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422ce40b8014480ca8e13695c7dc3cf9', 'request_id': 'req-5a25eada-c0ec-4594-a25e-a357577f4e06'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.688952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] The token cache is being invalidate because project 422ce40b8014480ca8e13695c7dc3cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:23.689244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.689908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.691691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1050/2101] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:23 2022] DELETE /identity/v3/projects/422ce40b8014480ca8e13695c7dc3cf9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:23.699091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.701153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:23.742345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1052/2102] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:23.746587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.759349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3990de-54c0-4966-ba77-c21c30f1a81e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.764677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.765278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.765554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.765822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.767973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:23.767973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.768396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.773803 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:23.784497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1053/2103] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:28:23.788887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.807336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25eada-c0ec-4594-a25e-a357577f4e06 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.808414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6df35-61fd-4ac1-8c18-cf374246e8d1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:23.814793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.814978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:23.815438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.815587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:23.815719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.815865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:23.815997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] PATH_INFO: `/v3/users/9ea23e8c82924e329fc2d37b184d4e37` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.816130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:23.816807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.817174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea23e8c82924e329fc2d37b184d4e37)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:23.819718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.824949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:23.858244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1054/2104] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:23 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:23.861522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:23.885841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea23e8c82924e329fc2d37b184d4e37'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.886820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea23e8c82924e329fc2d37b184d4e37'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.900655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea23e8c82924e329fc2d37b184d4e37'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.901320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea23e8c82924e329fc2d37b184d4e37'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.910806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea23e8c82924e329fc2d37b184d4e37'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:23.932165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1051/2105] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:23 2022] DELETE /identity/v3/users/9ea23e8c82924e329fc2d37b184d4e37 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:23.940217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd7eb-37cf-48b5-8d02-e8d9801105d8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.057753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:24.077344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.077344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.077344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.077344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.077937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.079115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.116294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1055/2106] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:23 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:24.121650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.124363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.141942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a5568-a3ea-4d3f-8486-df1167e53925 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.147216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.148277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.148464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.149430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.150130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.151798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.165493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1052/2107] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:24.169522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.180187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8eda8-1227-40dd-9693-8c28e8f4a9b3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.186687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.187295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.187572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.187842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.189015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.190682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d106af-60aa-43a5-b568-957d4512c0d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.201995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1056/2108] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:24.205134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.215038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c48d3-7f1f-4f33-b4a0-a19ab06152cf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.220184 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.221118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.221118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.221372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] PATH_INFO: `/v3/projects/e776bd2f066c459b998d54952c3a7819/users/ecd2aa7b72674b6a84456393bfcd0a56/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.237093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e776bd2f066c459b998d54952c3a7819, user_id=ecd2aa7b72674b6a84456393bfcd0a56, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.239851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.254425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1053/2109] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:24 2022] PUT /identity/v3/projects/e776bd2f066c459b998d54952c3a7819/users/ecd2aa7b72674b6a84456393bfcd0a56/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:24.264848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.265138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.265406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.295022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] MFA Rules not processed for user `ecd2aa7b72674b6a84456393bfcd0a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:24.296806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.302049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.303831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.373393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1057/2110] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:24.379313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25de7d-f040-4968-b8b5-c1ee74b7aafa admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.384596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.385483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.387098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.387719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.388001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.388284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] PATH_INFO: `/v3/projects/2b5943940ac641f3b64c8a0f20c5bc0a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.389548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5943940ac641f3b64c8a0f20c5bc0a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.391555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.431104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:24.448346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5943940ac641f3b64c8a0f20c5bc0a', 'request_id': 'req-9fac141f-9197-4752-8a6f-2bffb9625ebf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.454246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5943940ac641f3b64c8a0f20c5bc0a', 'request_id': 'req-9fac141f-9197-4752-8a6f-2bffb9625ebf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.462715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5943940ac641f3b64c8a0f20c5bc0a', 'request_id': 'req-9fac141f-9197-4752-8a6f-2bffb9625ebf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.474743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] The token cache is being invalidate because project 2b5943940ac641f3b64c8a0f20c5bc0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:24.475040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.475684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.477186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1054/2111] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:24 2022] DELETE /identity/v3/projects/2b5943940ac641f3b64c8a0f20c5bc0a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:24.480325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41ce2a-08fb-4d00-900c-a7d304b7e4f0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.481003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.482344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.529189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.530461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.530736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.531031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.532791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:24.547847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:24.548023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac141f-9197-4752-8a6f-2bffb9625ebf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:24.552792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:24.553480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:24.553873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:24.554181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] PATH_INFO: `/v3/users/34c351e966fa4bbd86064fa9dab1aad0` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:24.555302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c351e966fa4bbd86064fa9dab1aad0)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.557219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.597305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:24.598791 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:24.604646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c351e966fa4bbd86064fa9dab1aad0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.605321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c351e966fa4bbd86064fa9dab1aad0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.608850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1058/2112] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:24.618231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c351e966fa4bbd86064fa9dab1aad0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.618931 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c351e966fa4bbd86064fa9dab1aad0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.627197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1b76b801-b4d0-467a-b8de-12ae0d94d2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c351e966fa4bbd86064fa9dab1aad0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:24.640279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1055/2113] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:24 2022] DELETE /identity/v3/users/34c351e966fa4bbd86064fa9dab1aad0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:24.924989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:24.944989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570e41b-cbe4-40d9-a3a1-1f760cd03041 service glance] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.009371 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.010025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.010302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.010570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] PATH_INFO: `/v3/projects/35aabdd6e20041049499a60bae9b723e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.011684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35aabdd6e20041049499a60bae9b723e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.013625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.081063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35aabdd6e20041049499a60bae9b723e', 'request_id': 'req-2f38edf1-838e-4aa0-b433-4f4e65207f32'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:25.088522 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35aabdd6e20041049499a60bae9b723e', 'request_id': 'req-2f38edf1-838e-4aa0-b433-4f4e65207f32'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:25.099664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35aabdd6e20041049499a60bae9b723e', 'request_id': 'req-2f38edf1-838e-4aa0-b433-4f4e65207f32'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:25.114536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] The token cache is being invalidate because project 35aabdd6e20041049499a60bae9b723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:25.114871 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:25.115606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2f38edf1-838e-4aa0-b433-4f4e65207f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:25.117873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1059/2114] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:24 2022] DELETE /identity/v3/projects/35aabdd6e20041049499a60bae9b723e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:25.124245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.124527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.124802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.148370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:25.162498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:25.202756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:25.239704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1056/2115] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:25.248645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.248927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.249243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.270970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:25.272380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:25.282553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1060/2116] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:25.286504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.297478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c997b0-805c-46e0-ac54-e43399a0fd7e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.303499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.304159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.304386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.304715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.305368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:25.305672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.307476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.321768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1057/2117] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:28:25.327267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.338031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab929c-ff34-41bf-b8d5-8b48456b4503 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.344364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.345100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.345531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.345942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.353010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.355016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.398490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1061/2118] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:25 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:25.399787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.416321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e005b-ebfa-48a6-99cd-ac82ed694af4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.485226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.485844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.490419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.491045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.492720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.505793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.524122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1058/2119] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:25 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:25.528845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.542923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659d250-53f4-40d7-8bb2-727c263ad74b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.551432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.552125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.552471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.552810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.553737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.556090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.568086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1062/2120] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:25.572105 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.583180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1161c6-b533-4ac3-85b2-01b42e2dcf07 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.587946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.588510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.588814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.589098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.589814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.591799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddf6ce-6354-4043-9af2-b55837f2c223 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.604146 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1059/2121] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:25.608373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:25.618996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471e26-1531-4ae4-b959-874be3f9f262 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:25.623587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:25.624224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.624501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.624768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] PATH_INFO: `/v3/projects/54d3df317db0499e9db5fcec414244c8/users/00869c02c7ca4a86b1eee65e015c8aeb/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.626969 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:25.643825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d3df317db0499e9db5fcec414244c8, user_id=00869c02c7ca4a86b1eee65e015c8aeb, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:25.646595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:25.660112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1063/2122] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:25 2022] PUT /identity/v3/projects/54d3df317db0499e9db5fcec414244c8/users/00869c02c7ca4a86b1eee65e015c8aeb/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:25.672276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:25.672563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:25.672861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:25.699913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] MFA Rules not processed for user `00869c02c7ca4a86b1eee65e015c8aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:25.701046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:25.770544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1060/2123] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:26.680462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:26.682176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:26.741207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed5ad6-d288-45f1-8c10-70ff325aee15 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:26.745821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:26.746685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:26.746987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:26.747397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:26.750248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:26.823786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:26.825224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5c88b-aafb-4f9d-aef7-3f56e425886d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:26.838722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1064/2124] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:31.730188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:31.731727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:31.765630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:31.797502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a498b0-7f7c-4434-9c62-e0093c6b05dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:31.802154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:31.802782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:31.803061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:31.803336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] PATH_INFO: `/v3/users/99f7714369394024a57887c13f15e9db` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:31.804451 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f7714369394024a57887c13f15e9db)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:31.806432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:31.858878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f7714369394024a57887c13f15e9db'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:31.859534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f7714369394024a57887c13f15e9db'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:31.871794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f7714369394024a57887c13f15e9db'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:31.872427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f7714369394024a57887c13f15e9db'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:31.879046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f7714369394024a57887c13f15e9db'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:31.891467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1061/2125] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:31 2022] DELETE /identity/v3/users/99f7714369394024a57887c13f15e9db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:31.895935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:31.896383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:31.896474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:31.915610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:31.916806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:31.977646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1065/2126] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:31.987827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:31.989260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:32.050039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac83f-ec48-4123-a853-83d2eaaf4d49 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:32.053776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:32.054399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:32.054673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:32.054944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:32.063659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:32.065080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:32.074417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1062/2127] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:32.423707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:32.425404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:32.439882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7085a-4b31-4f80-852b-e1d1244e1d42 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:32.446265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:32.447133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:32.447601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:32.448279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] PATH_INFO: `/v3/projects/0ed40744fa2d4532bb7899c62148cc14` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:32.449604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed40744fa2d4532bb7899c62148cc14)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:32.451709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:32.491388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:32.519405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed40744fa2d4532bb7899c62148cc14', 'request_id': 'req-0a2a17ba-bf92-4397-b522-27c4f96f5b10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.525210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed40744fa2d4532bb7899c62148cc14', 'request_id': 'req-0a2a17ba-bf92-4397-b522-27c4f96f5b10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.532761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed40744fa2d4532bb7899c62148cc14', 'request_id': 'req-0a2a17ba-bf92-4397-b522-27c4f96f5b10'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.543983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] The token cache is being invalidate because project 0ed40744fa2d4532bb7899c62148cc14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:32.544272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.544968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.546690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1066/2128] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:32 2022] DELETE /identity/v3/projects/0ed40744fa2d4532bb7899c62148cc14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:32.550819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:32.560284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ffe7-ce8a-43e9-b9fe-55b1999e6c36 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:32.609680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:32.619815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:32.620436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:32.620719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:32.620991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] PATH_INFO: `/v3/users/64edfd738cb6480eb3766f43b0f68747` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:32.622130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64edfd738cb6480eb3766f43b0f68747)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:32.624120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:32.671904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64edfd738cb6480eb3766f43b0f68747'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.672546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64edfd738cb6480eb3766f43b0f68747'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.684319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64edfd738cb6480eb3766f43b0f68747'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.684983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64edfd738cb6480eb3766f43b0f68747'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.692897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-91531005-acb2-4c51-afcb-e4bc3df02c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64edfd738cb6480eb3766f43b0f68747'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:32.706391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1063/2129] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:32 2022] DELETE /identity/v3/users/64edfd738cb6480eb3766f43b0f68747 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:32.992526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.015089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:33.028465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a17ba-bf92-4397-b522-27c4f96f5b10 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.089536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.090124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.090408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.090719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] PATH_INFO: `/v3/projects/e2605a1174d84bd899cfba4a68b93f00` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.091878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2605a1174d84bd899cfba4a68b93f00)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.094524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.139938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2605a1174d84bd899cfba4a68b93f00', 'request_id': 'req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:33.145657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2605a1174d84bd899cfba4a68b93f00', 'request_id': 'req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:33.154325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2605a1174d84bd899cfba4a68b93f00', 'request_id': 'req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:33.166781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] The token cache is being invalidate because project e2605a1174d84bd899cfba4a68b93f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:33.167093 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:33.167743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b3c82e22-cbd2-49f0-9b2a-c4bfb7b58700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:33.169233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1067/2130] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:32 2022] DELETE /identity/v3/projects/e2605a1174d84bd899cfba4a68b93f00 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:33.175182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.175648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.175739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.195381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:33.196565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:33.256580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1064/2131] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:33.266111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.266394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.266664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.286122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:33.287340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:33.295231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1068/2132] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:33.299516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.309230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1eeb9-9919-472d-8250-1af2de095a6a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.317034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.317514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.317791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.318088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.318746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:33.319098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.320650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.338942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1065/2133] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:28:33.344588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.354723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da2f99-54cb-4df9-9620-cb1da916e2c0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.359351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.359990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.360267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.360534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.361165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.363121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.390985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1069/2134] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:33.395336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.405292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00dab7-af92-4642-9aec-1b25fe0e0ed4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.461521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.462164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.462449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.462720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.463333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.465235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.473259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:33.488810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1066/2135] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:33.492153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.503215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce880c-aa33-47dd-aadc-9a306561ffb9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.507910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.508573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.508910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.509246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.509985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.511637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.528210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1070/2136] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:33.530958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.541449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16a49-7d5f-4f24-9a71-c56cc9a3433e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.546876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.547565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.547846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.548118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.548762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.551367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc947f37-21a7-4a45-9d1f-e8211d6f9428 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.563173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1067/2137] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:33.567323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.578895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047b44a-d48b-421d-a8b7-bb7dde504639 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.583513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.584210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.584490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.584765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] PATH_INFO: `/v3/projects/67850e55487b42588963e11affb038a3/users/956497a18f43418db90f19cc952d878f/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.587114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:33.602511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67850e55487b42588963e11affb038a3, user_id=956497a18f43418db90f19cc952d878f, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.605095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.618809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1071/2138] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:33 2022] PUT /identity/v3/projects/67850e55487b42588963e11affb038a3/users/956497a18f43418db90f19cc952d878f/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:33.631051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.631338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.631612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.658330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] MFA Rules not processed for user `956497a18f43418db90f19cc952d878f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:33.659533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:33.731260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1068/2139] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:33.736391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.798989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfe200-c3e6-4c53-8810-582286b37a42 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.804051 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.804661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.804932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.805197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.805824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.807758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.834550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1072/2140] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:33.838625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.849093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8acd6-3616-4d5d-b976-28c6062bb07d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.908396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.908914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.909188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.909457 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.910133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.912034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.935094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1069/2141] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:33 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:33.936211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.946672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b23ac4-06ed-4df9-a841-a11ee93cf13b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.951192 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.951777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.952049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.952314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.952943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.954570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.964863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1073/2142] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:33.968916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:33.978872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de8315-65d5-4fe6-ae13-c0d5e8bca4a6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:33.984372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:33.984958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:33.985235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:33.985503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:33.986172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:33.987749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2bc64-dd27-488f-b2e3-e22bb6b5c11b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:33.997635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1070/2143] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:34.001723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.011442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802f1ce-acae-4b35-aa64-86410c82ae74 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.016055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.016682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.016957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.017228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] PATH_INFO: `/v3/projects/73a000cba48e4569bf04831a5930be5f/users/a26a36ad30ce46d6a3c590ed12720815/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.033493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a000cba48e4569bf04831a5930be5f, user_id=a26a36ad30ce46d6a3c590ed12720815, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.036196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.049667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1074/2144] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:34 2022] PUT /identity/v3/projects/73a000cba48e4569bf04831a5930be5f/users/a26a36ad30ce46d6a3c590ed12720815/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:34.060971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.061258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.061533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.088733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] MFA Rules not processed for user `a26a36ad30ce46d6a3c590ed12720815`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:34.089939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:34.127624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.129455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:34.129665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:34.164497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1071/2145] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:34.169569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.194639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997c82c-bc1b-4076-8bdf-6c589fce86f5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.199025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.200078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.200357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.200614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.203599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:34.249590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824840a-2a87-4c43-8968-5601341abb04 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.254478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.255156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.255497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.255798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.256284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:34.256439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.258987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.271875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.273415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.283443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1075/2146] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:34.290020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1072/2147] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:34 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:34.293932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.304726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0717-6c9f-492b-9742-83ce9d8b60c0 service glance] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.385206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.385700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.385998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.386267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.386902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.388824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.414855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1076/2148] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:34 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:34.420882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.431208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f892e3b-ce98-4ecb-bf14-f6a1be7c15cf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.435994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.436666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.437005 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.437362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.438111 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.439767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.449620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1073/2149] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:34.454437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.464898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d22e6-9132-46d8-bbcb-f518e6ba5547 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.471672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.472350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.472630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.472906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] PATH_INFO: `/v3/projects/385c55f045d84abe814e51b23875b483/users/4e1165e07c904d2ea2e73998899c24b0/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.489537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385c55f045d84abe814e51b23875b483, user_id=4e1165e07c904d2ea2e73998899c24b0, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.492718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.514057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1077/2150] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:34 2022] PUT /identity/v3/projects/385c55f045d84abe814e51b23875b483/users/4e1165e07c904d2ea2e73998899c24b0/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:34.517928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.527724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04615b-e0d9-463e-86e3-cb749cd53458 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.587752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.588423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.588768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.589102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.589812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.591488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cc9b-e8dd-483f-aefd-02436ea8a24a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.605056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1074/2151] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:34.609311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.620947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc90b13-4a56-443b-8166-5b143be95a20 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.628768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.629613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.630145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.630523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] PATH_INFO: `/v3/projects/385c55f045d84abe814e51b23875b483/users/4e1165e07c904d2ea2e73998899c24b0/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.633230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385c55f045d84abe814e51b23875b483, user_id=4e1165e07c904d2ea2e73998899c24b0, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.637337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.651499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1078/2152] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:34 2022] PUT /identity/v3/projects/385c55f045d84abe814e51b23875b483/users/4e1165e07c904d2ea2e73998899c24b0/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:34.662699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.663245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.663735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.696293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] MFA Rules not processed for user `4e1165e07c904d2ea2e73998899c24b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:34.697758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:34.745436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:34.800232 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1075/2153] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:34.815229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:34.817120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:34.881469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd2410-e953-4e5d-996c-c6ef2a462e02 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:34.885202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:34.885877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:34.886178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:34.886443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:34.939014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:34.943457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:34.944972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:34.955187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1079/2154] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:36.479502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:36.481032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:36.493254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef34c4f-c94c-49e6-a307-f08c4d5de34d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:36.496796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:36.497422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:36.497701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:36.497986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:36.561822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:36.563227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:36.572179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1076/2155] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:37.142575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:37.151069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d4c65-f349-4c5d-94e7-57c11b18fa3f service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:37.155211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:37.155817 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:37.156094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:37.156360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:37.169017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:37.170147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491cc53-a865-4121-8e64-2d58b8c3bcc9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:37.182451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1080/2156] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:41.097104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:41.190361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fed0dd-fd7b-4978-85af-f76541c1e5c7 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:41.195599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:41.196364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:41.196754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:41.197127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] PATH_INFO: `/v3/users/956497a18f43418db90f19cc952d878f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:41.198402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956497a18f43418db90f19cc952d878f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:41.200389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:41.255060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956497a18f43418db90f19cc952d878f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.255825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956497a18f43418db90f19cc952d878f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.271439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956497a18f43418db90f19cc952d878f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.272278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956497a18f43418db90f19cc952d878f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.281710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956497a18f43418db90f19cc952d878f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.283337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:41.309391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1077/2157] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:41 2022] DELETE /identity/v3/users/956497a18f43418db90f19cc952d878f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:41.311188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:41.311991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:41.312307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:41.334117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:41.335548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:41.451182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1081/2158] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:41.461873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:41.463673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:41.529771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124b67-78cc-4626-8cad-de4ab9f38b77 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:41.534637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:41.535386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:41.535802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:41.536079 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:41.547299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:41.548812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:41.558742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1078/2159] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:41.830576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:41.832012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:41.846699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcd26a-ee7e-43b1-999e-1f309769e3f7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:41.852445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:41.853063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:41.853345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:41.853639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] PATH_INFO: `/v3/projects/67850e55487b42588963e11affb038a3` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:41.854748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67850e55487b42588963e11affb038a3)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:41.856714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:41.909682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67850e55487b42588963e11affb038a3', 'request_id': 'req-e761a242-e25e-4c9a-b467-3628c5c77fa7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.915480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67850e55487b42588963e11affb038a3', 'request_id': 'req-e761a242-e25e-4c9a-b467-3628c5c77fa7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.923298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67850e55487b42588963e11affb038a3', 'request_id': 'req-e761a242-e25e-4c9a-b467-3628c5c77fa7'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.934679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] The token cache is being invalidate because project 67850e55487b42588963e11affb038a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:41.934968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.935597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:41.937759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1082/2160] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:41 2022] DELETE /identity/v3/projects/67850e55487b42588963e11affb038a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:41.941854 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:41.951535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358af16e-b2c5-4369-ad2a-53a5f9aac29a service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:42.014152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:42.014868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:42.015295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:42.015572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] PATH_INFO: `/v3/users/a26a36ad30ce46d6a3c590ed12720815` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:42.016707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26a36ad30ce46d6a3c590ed12720815)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:42.018740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:42.064568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26a36ad30ce46d6a3c590ed12720815'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.065216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26a36ad30ce46d6a3c590ed12720815'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.076806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26a36ad30ce46d6a3c590ed12720815'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.077429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26a36ad30ce46d6a3c590ed12720815'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.083864 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26a36ad30ce46d6a3c590ed12720815'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.096742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1079/2161] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:41 2022] DELETE /identity/v3/users/a26a36ad30ce46d6a3c590ed12720815 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:42.376930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:42.378420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:42.394708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a242-e25e-4c9a-b467-3628c5c77fa7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:42.451258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:42.451894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:42.452176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:42.452498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] PATH_INFO: `/v3/projects/73a000cba48e4569bf04831a5930be5f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:42.453664 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a000cba48e4569bf04831a5930be5f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:42.455628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:42.462313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:42.518573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a000cba48e4569bf04831a5930be5f', 'request_id': 'req-31409c51-e6e9-458e-a59a-64197577736d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.524695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a000cba48e4569bf04831a5930be5f', 'request_id': 'req-31409c51-e6e9-458e-a59a-64197577736d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.540262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a000cba48e4569bf04831a5930be5f', 'request_id': 'req-31409c51-e6e9-458e-a59a-64197577736d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.552647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] The token cache is being invalidate because project 73a000cba48e4569bf04831a5930be5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:42.552936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.553574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.555459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1083/2162] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:42 2022] DELETE /identity/v3/projects/73a000cba48e4569bf04831a5930be5f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:42.559946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:42.561771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:42.574999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3153-df19-4b68-979a-3588d66e09a8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:42.585199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:42.644793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:42.645433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:42.645716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:42.646026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] PATH_INFO: `/v3/users/4e1165e07c904d2ea2e73998899c24b0` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:42.647458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1165e07c904d2ea2e73998899c24b0)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:42.649627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:42.700749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1165e07c904d2ea2e73998899c24b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.701950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1165e07c904d2ea2e73998899c24b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.715612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1165e07c904d2ea2e73998899c24b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.716331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1165e07c904d2ea2e73998899c24b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.726227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bb2c1cf2-9fea-4139-8cbe-e470264012b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1165e07c904d2ea2e73998899c24b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:42.748113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1080/2163] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:42 2022] DELETE /identity/v3/users/4e1165e07c904d2ea2e73998899c24b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:43.171284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.172648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:43.188889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31409c51-e6e9-458e-a59a-64197577736d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.272104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.273108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.273384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.273650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] PATH_INFO: `/v3/projects/385c55f045d84abe814e51b23875b483` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.274819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=385c55f045d84abe814e51b23875b483)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.276775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.328556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385c55f045d84abe814e51b23875b483', 'request_id': 'req-d62f75c0-7d55-44ff-a22f-353e3d81be1a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:43.334581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385c55f045d84abe814e51b23875b483', 'request_id': 'req-d62f75c0-7d55-44ff-a22f-353e3d81be1a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:43.342962 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385c55f045d84abe814e51b23875b483', 'request_id': 'req-d62f75c0-7d55-44ff-a22f-353e3d81be1a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:43.355930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] The token cache is being invalidate because project 385c55f045d84abe814e51b23875b483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:43.356219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:43.356867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d62f75c0-7d55-44ff-a22f-353e3d81be1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:43.358447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1084/2164] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:43 2022] DELETE /identity/v3/projects/385c55f045d84abe814e51b23875b483 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:43.363401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.363691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.363964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.389564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:43.390897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:43.456764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1081/2165] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:43.465976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.466491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.466749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.493861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:43.495208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:43.506238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1085/2166] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:43.510706 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.521445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103e64-878f-4332-a51b-d948d88596e3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.526390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.527099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.527442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.528002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.528724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:43.529143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.531419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.545230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1082/2167] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:28:43.550312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.561472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39d612-4e77-4ceb-a2f8-f27e42dab784 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.566893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.567559 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.567855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.568124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.568750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.570706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.588300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:43.601713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1086/2168] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:28:43.605949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.615917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6decdd-c49b-4a4c-a4b6-f045b04996c5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.633997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:43.680447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.681219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.681644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.681986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.682743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.684798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.715160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1083/2169] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:43.716659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.727101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb364f-22c3-4e8a-93dc-4a783cc33e50 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.731850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.732449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.732759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.733033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.733679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.735314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.745455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1087/2170] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:43.750074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.760188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a176a-f203-4a54-8686-1006d2181309 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.772310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.773121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.773409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.773688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.774382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.775995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcdec6-ce9e-46f4-9da8-05a42c3a3ee9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.787199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1084/2171] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:43.791495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.802162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba8fdd-7f57-4145-9b20-6ab3b4e6ddf8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:43.807231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:43.807911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.808191 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.808590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] PATH_INFO: `/v3/projects/70bbfb52ee3f47298b2432c13501d34f/users/f3153a67fb994162bd3099de255825e2/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.829105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bbfb52ee3f47298b2432c13501d34f, user_id=f3153a67fb994162bd3099de255825e2, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:43.832230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf657425-928d-42f1-905f-e3a7e60149d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:43.846373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1088/2172] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:43 2022] PUT /identity/v3/projects/70bbfb52ee3f47298b2432c13501d34f/users/f3153a67fb994162bd3099de255825e2/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:43.856637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.856856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.857128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.888409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] MFA Rules not processed for user `f3153a67fb994162bd3099de255825e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:43.890822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:43.947441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35953-8e3b-4b0e-bb0d-0efa56a6ae92 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:43.947803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35953-8e3b-4b0e-bb0d-0efa56a6ae92 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:43.948148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35953-8e3b-4b0e-bb0d-0efa56a6ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:43.967244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-20f35953-8e3b-4b0e-bb0d-0efa56a6ae92 None None] MFA Rules not processed for user `be489ecec19847829df7c4488986373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:43.968454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-20f35953-8e3b-4b0e-bb0d-0efa56a6ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:43.978151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1085/2173] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:43.986147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:43.987502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:44.041485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1089/2174] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:44.056974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07a804-bb44-4306-b731-7153c5a95d53 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:44.060243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:44.061479 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:44.061760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:44.062313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:44.071023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:44.072442 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:44.081254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1086/2175] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:52.668102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbb90-8969-4e65-a9aa-9af786c379d9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:52.668569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbb90-8969-4e65-a9aa-9af786c379d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:52.668669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dbb90-8969-4e65-a9aa-9af786c379d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:52.688658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-840dbb90-8969-4e65-a9aa-9af786c379d9 None None] MFA Rules not processed for user `b2e79830079c4aa9b95c4622bac45c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:52.690113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-840dbb90-8969-4e65-a9aa-9af786c379d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:52.746588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1090/2176] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:54.077244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:54.778162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:54.842850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281794a-734f-47b7-9bc4-34872fc4f81e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:54.849173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:54.849815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:54.850124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:54.850396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] PATH_INFO: `/v3/users/f3153a67fb994162bd3099de255825e2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:54.851525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3153a67fb994162bd3099de255825e2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:54.853486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:54.905542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3153a67fb994162bd3099de255825e2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:54.906216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3153a67fb994162bd3099de255825e2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:54.919224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3153a67fb994162bd3099de255825e2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:54.919973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3153a67fb994162bd3099de255825e2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:54.927869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3153a67fb994162bd3099de255825e2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:54.943291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1087/2177] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:28:54 2022] DELETE /identity/v3/users/f3153a67fb994162bd3099de255825e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:54.947583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:54.948120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:54.948120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:54.968393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:54.970136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:55.045708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1091/2178] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:55.057269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.058770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:55.137412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a456d-84ea-409a-be6d-d1e5aaf05519 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.141920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.142575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.142851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.143128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.154211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.155671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8791a67-65b6-451d-9351-b39f25973ed9 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.179380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1088/2179] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:28:55.519696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.521165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:55.537650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918334f6-21e3-4b44-bc80-2bb98fb5bb7d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.543108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.543651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.543986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.544186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] PATH_INFO: `/v3/projects/70bbfb52ee3f47298b2432c13501d34f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.545876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bbfb52ee3f47298b2432c13501d34f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.547897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.554592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:55.594882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bbfb52ee3f47298b2432c13501d34f', 'request_id': 'req-fda748af-cb3f-45df-99f4-614dad2d38e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:55.600295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bbfb52ee3f47298b2432c13501d34f', 'request_id': 'req-fda748af-cb3f-45df-99f4-614dad2d38e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:55.608826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bbfb52ee3f47298b2432c13501d34f', 'request_id': 'req-fda748af-cb3f-45df-99f4-614dad2d38e6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:55.620002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] The token cache is being invalidate because project 70bbfb52ee3f47298b2432c13501d34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:28:55.620289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:55.620906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-fda748af-cb3f-45df-99f4-614dad2d38e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:28:55.622418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1092/2180] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:28:55 2022] DELETE /identity/v3/projects/70bbfb52ee3f47298b2432c13501d34f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:28:55.627857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.628141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.628415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.647544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:55.648739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:55.665930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:28:55.714418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1089/2181] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:28:55.722823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.723124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.723394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.743925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:55.745142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:55.753020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1093/2182] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:55.757312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.767107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1b9f-cdc4-49e4-a838-0c06220fd549 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.771699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.772292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.772569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.772838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.773474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:28:55.773811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.775648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.788618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1090/2183] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:28:55.792844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.803968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7e05-dd1b-4f4b-a055-ef97c61cd592 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.809013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.809716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.810027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.810331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.812355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.814144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.846006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1094/2184] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:28:55 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:55.849359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.860737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22abe2c-cd86-4938-aa60-aa5641b83d76 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.926953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.927559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.927833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.928099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.928701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.930634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.950858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1091/2185] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:28:55 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:28:55.955035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:55.965367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226e62c-f227-4e08-968a-c72665471230 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:55.970485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:55.971076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:55.971347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:55.971616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:55.972247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:55.974660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:55.989645 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1095/2186] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:28:55.991036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:56.001486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08660c-6d09-4f53-b4f3-c3db26a33d4b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:56.006637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:56.007321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:56.007606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:56.007878 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:56.008555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:56.010180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe44bbe-9197-44dd-b83a-b676c87b4b1e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:56.022555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1092/2187] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:28:56.034351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:56.044498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3b153-48fa-4cd1-abdf-fe8daf3d873e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:56.049119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:56.049943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:56.050427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:56.050702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] PATH_INFO: `/v3/projects/dff5f819881740bdaf17b55517377f88/users/a8d81455253f4a7db8327f9999a90481/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:56.065578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff5f819881740bdaf17b55517377f88, user_id=a8d81455253f4a7db8327f9999a90481, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:56.068887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:56.082842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1096/2188] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:28:56 2022] PUT /identity/v3/projects/dff5f819881740bdaf17b55517377f88/users/a8d81455253f4a7db8327f9999a90481/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:28:56.093387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105118c-56d8-4080-9509-37dd8e55d369 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:56.093664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105118c-56d8-4080-9509-37dd8e55d369 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:56.093928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105118c-56d8-4080-9509-37dd8e55d369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:56.121394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d105118c-56d8-4080-9509-37dd8e55d369 None None] MFA Rules not processed for user `a8d81455253f4a7db8327f9999a90481`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:28:56.122627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d105118c-56d8-4080-9509-37dd8e55d369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:56.206863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1093/2189] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:28:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:28:56.218553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:28:56.220260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:28:56.276109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168b8c-6ed7-4c2a-bef5-a0ffc65604e2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:28:56.280284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:28:56.280874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:28:56.281145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:28:56.281409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:28:56.289798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:28:56.291256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:28:56.300009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1097/2190] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:28:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:05.505324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825f95-a895-443f-8510-58280739f9d2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:05.505788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825f95-a895-443f-8510-58280739f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:05.505911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825f95-a895-443f-8510-58280739f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:05.525316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-01825f95-a895-443f-8510-58280739f9d2 None None] MFA Rules not processed for user `f8b0c96c80db4db4a477a1fa6c1fa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:05.526548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01825f95-a895-443f-8510-58280739f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:05.538074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:05.581371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1094/2191] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:06.296022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:07.962482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:07.967035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:08.041238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78859e-589b-48d9-bb74-daaf5d71a24e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:08.049744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:08.050443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:08.050724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:08.051007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] PATH_INFO: `/v3/users/00869c02c7ca4a86b1eee65e015c8aeb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:08.052176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00869c02c7ca4a86b1eee65e015c8aeb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:08.054182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:08.102693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00869c02c7ca4a86b1eee65e015c8aeb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:08.103913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00869c02c7ca4a86b1eee65e015c8aeb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:08.117646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00869c02c7ca4a86b1eee65e015c8aeb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:08.124875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00869c02c7ca4a86b1eee65e015c8aeb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:08.132512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00869c02c7ca4a86b1eee65e015c8aeb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:08.138813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1098/2192] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:07 2022] DELETE /identity/v3/users/00869c02c7ca4a86b1eee65e015c8aeb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:08.143732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:08.144227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:08.145116 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:08.168682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:08.171335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:08.243008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1095/2193] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:08.253077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:08.254833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:08.319159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c64d3-7778-4cf6-9949-fd06bae05885 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:08.323399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:08.324705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:08.324705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:08.324705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:08.335823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:08.337262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b873-8043-4d76-89d0-912a2bc7558e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:08.353699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1099/2194] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:09.154143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.156981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:09.181885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782d20-5cc5-4ea7-b7aa-20d7f97347a8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.196534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.197471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.197820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.198183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] PATH_INFO: `/v3/projects/54d3df317db0499e9db5fcec414244c8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.199540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d3df317db0499e9db5fcec414244c8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.203336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.362382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d3df317db0499e9db5fcec414244c8', 'request_id': 'req-c63c1310-521f-446d-9035-831b452a75d3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.380780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d3df317db0499e9db5fcec414244c8', 'request_id': 'req-c63c1310-521f-446d-9035-831b452a75d3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.392395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d3df317db0499e9db5fcec414244c8', 'request_id': 'req-c63c1310-521f-446d-9035-831b452a75d3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.407926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] The token cache is being invalidate because project 54d3df317db0499e9db5fcec414244c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:09.408555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.409368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c63c1310-521f-446d-9035-831b452a75d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.411766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1096/2195] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:09 2022] DELETE /identity/v3/projects/54d3df317db0499e9db5fcec414244c8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:09.416608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.417117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.417231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.442870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:09.443933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:09.470854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:09.535752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1100/2196] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:09.543921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.544422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.544695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.570373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:09.572056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:09.586866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1097/2197] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:09.590705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.605111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b8116-baa2-45c7-bb32-4d7945136a3d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.611193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.612092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.612519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.612964 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.613920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:29:09.614411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.616193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.631874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1101/2198] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:29:09.636472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.647530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706de2-ce1c-4c62-86fb-29f682f42c91 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.652586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.653216 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.653618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.653892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.654559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.656760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.690174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1098/2199] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:09 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:09.693697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.713165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22384-f5a5-403e-917b-5de868dc55c1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.733150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.735642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:09.767004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:09.796150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.801337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.801659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.801940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.802609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.804650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.833058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1102/2200] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:09 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:29:09.837132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.843648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a98e0-9759-4350-9cbb-610236e11bf4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.849080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.849862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.850229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.850569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] PATH_INFO: `/v3/users/ecd2aa7b72674b6a84456393bfcd0a56` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.851527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71501-9e25-4d59-af58-c49aa87fc8ae admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.851860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd2aa7b72674b6a84456393bfcd0a56)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.854655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.858513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.859540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.860232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.860777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.862684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.864644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.882119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1103/2201] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:29:09.886138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.899897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168f8d2-6d34-447d-b93f-e003e1eae339 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.910622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.912405 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.912646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.912968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.913669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:09.915349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:09.929742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1104/2202] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:09.934127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:09.958194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd2aa7b72674b6a84456393bfcd0a56'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.959796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd2aa7b72674b6a84456393bfcd0a56'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.963746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0199938-b03f-4c8d-bc12-36a9544c2656 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:09.974893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:09.975419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:09.975819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:09.976600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] PATH_INFO: `/v3/projects/043779a089cd49f6b3b55df4542e4537/users/b382d9626c5e4b9989409ee81d07b8e1/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:09.994794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd2aa7b72674b6a84456393bfcd0a56'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:09.995943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd2aa7b72674b6a84456393bfcd0a56'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.001777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] RBAC: Authorizing `identity:create_grant(project_id=043779a089cd49f6b3b55df4542e4537, user_id=b382d9626c5e4b9989409ee81d07b8e1, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.006488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa4575-98bd-4899-adc6-5f06fdbe764d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.009788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd2aa7b72674b6a84456393bfcd0a56'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.029452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1099/2203] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:09 2022] DELETE /identity/v3/users/ecd2aa7b72674b6a84456393bfcd0a56 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:10.030776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.030954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1105/2204] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:09 2022] PUT /identity/v3/projects/043779a089cd49f6b3b55df4542e4537/users/b382d9626c5e4b9989409ee81d07b8e1/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:10.032713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.033790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf6da-2293-4114-9086-fc2888ba735a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.034376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf6da-2293-4114-9086-fc2888ba735a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.034759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acf6da-2293-4114-9086-fc2888ba735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.079392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d7acf6da-2293-4114-9086-fc2888ba735a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:10.086710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d7acf6da-2293-4114-9086-fc2888ba735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.123520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656101b-e808-4520-a0e8-6f4e99937d9b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.130933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.131988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.132544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.132964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] PATH_INFO: `/v3/users/a8d81455253f4a7db8327f9999a90481` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.134941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d81455253f4a7db8327f9999a90481)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.137127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.173071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:10.196043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1106/2205] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:10.198302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59542-6156-4013-b6e4-5f8dca0cc2d9 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.198724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59542-6156-4013-b6e4-5f8dca0cc2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.198827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc59542-6156-4013-b6e4-5f8dca0cc2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.242616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0cc59542-6156-4013-b6e4-5f8dca0cc2d9 None None] MFA Rules not processed for user `b382d9626c5e4b9989409ee81d07b8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:10.244113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0cc59542-6156-4013-b6e4-5f8dca0cc2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.244979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:10.253468 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d81455253f4a7db8327f9999a90481'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.254233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d81455253f4a7db8327f9999a90481'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.278424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d81455253f4a7db8327f9999a90481'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.283917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d81455253f4a7db8327f9999a90481'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.300926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d81455253f4a7db8327f9999a90481'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:10.349250 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1100/2206] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:10 2022] DELETE /identity/v3/users/a8d81455253f4a7db8327f9999a90481 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:10.350247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.353437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.371161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1107/2207] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:10.381264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.381928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.381928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.406486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:10.407872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.475254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405124-3e7d-4160-9abc-ca3b7fbcefc6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.479441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.480269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.480649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.481023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.483759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.539009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1108/2208] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:10.540157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.541474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:10.561735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441adcd-4697-4529-8728-6bf1b4eb5f34 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.576273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.576928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.577200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.577463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.578129 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.579927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.580712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.582170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.602884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1101/2209] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:10.603995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.616843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75491b03-afb2-4333-b1dc-873e077af281 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.619732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1109/2210] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:10.623637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.681173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.682075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.682466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.682739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.704974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:10.752121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65f8d6-8d4b-4c8d-af79-7573d263b69e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.761139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.762724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.766654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.767410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.767788 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.768159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.768888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.774315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.775006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1102/2211] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:10.790895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:10.806294 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1110/2212] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:10 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:10.807239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.821435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b9b70-110e-45e2-894b-cb69bc15fffc service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.829602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.830761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.831759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.832569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.833370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.835430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.886923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1103/2213] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:29:10.889803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.909314 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded524-2821-4e89-a398-79091c58e5f0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.920554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.922299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.922918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.923202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.924353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.927156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471497f5-9f4b-44a8-99bb-e017e5be933a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:10.942507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1111/2214] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:10.946524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:10.961833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314324-b6b8-4f1e-865b-756cd3d49fdc admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:10.970094 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:10.970879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:10.971429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:10.971885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] PATH_INFO: `/v3/projects/586f1df9d193470397dfbdebe998fe9e/users/cf210314eafc4c479808e736f4102eeb/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:10.995846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=586f1df9d193470397dfbdebe998fe9e, user_id=cf210314eafc4c479808e736f4102eeb, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:10.999403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:11.022394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1104/2215] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:10 2022] PUT /identity/v3/projects/586f1df9d193470397dfbdebe998fe9e/users/cf210314eafc4c479808e736f4102eeb/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:11.036304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:11.036732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:11.037138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:11.074305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] MFA Rules not processed for user `cf210314eafc4c479808e736f4102eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:11.091829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:11.268106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:11.285946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1112/2216] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:11.365750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfefdc-acfa-4351-9857-74d2ed94e6da admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:11.387475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:11.388172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:11.388452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:11.388807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:11.390326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:11.395511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:11.424587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:11.434622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:11.493533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d289d6e-5d0b-4170-b44c-bdfcbcf4a626 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:11.517114 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1105/2217] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:11.518280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:11.522089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:11.523444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:11.523833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:11.524176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] PATH_INFO: `/v3/projects/e776bd2f066c459b998d54952c3a7819` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:11.525554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e776bd2f066c459b998d54952c3a7819)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:11.534483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:11.656200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e776bd2f066c459b998d54952c3a7819', 'request_id': 'req-f6d477b3-1b19-4b4c-97e4-198149fd3107'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:11.673518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e776bd2f066c459b998d54952c3a7819', 'request_id': 'req-f6d477b3-1b19-4b4c-97e4-198149fd3107'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:11.682482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e879d4-c062-4e8b-956b-53388e3e5982 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:11.689130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e776bd2f066c459b998d54952c3a7819', 'request_id': 'req-f6d477b3-1b19-4b4c-97e4-198149fd3107'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:11.707271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:11.713071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] The token cache is being invalidate because project e776bd2f066c459b998d54952c3a7819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:11.713376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:11.717905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:11.723615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1113/2218] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:11 2022] DELETE /identity/v3/projects/e776bd2f066c459b998d54952c3a7819 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:11.725108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:11.732010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:11.904689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:11.921860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:11.922588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:11.923441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:11.923726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:11.924378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:11.926680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:11.930641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d477b3-1b19-4b4c-97e4-198149fd3107 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:11.945534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:11.946287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:11.946569 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:11.946850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] PATH_INFO: `/v3/projects/dff5f819881740bdaf17b55517377f88` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:11.949789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff5f819881740bdaf17b55517377f88)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:11.952237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.010491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1106/2219] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:11 2022] POST /identity/v3/users => generated 298 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:12.014483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.016171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.017426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff5f819881740bdaf17b55517377f88', 'request_id': 'req-7577a1e8-a255-4a9f-8733-b176289c5398'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:12.025531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff5f819881740bdaf17b55517377f88', 'request_id': 'req-7577a1e8-a255-4a9f-8733-b176289c5398'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:12.049945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b133-67ee-4822-9801-aa72070b3233 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.051763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff5f819881740bdaf17b55517377f88', 'request_id': 'req-7577a1e8-a255-4a9f-8733-b176289c5398'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:12.066626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] The token cache is being invalidate because project dff5f819881740bdaf17b55517377f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:12.067161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:12.068008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7577a1e8-a255-4a9f-8733-b176289c5398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:12.069728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1114/2220] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:11 2022] DELETE /identity/v3/projects/dff5f819881740bdaf17b55517377f88 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:12.075227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f64f5-4d00-4869-85df-d150b96fc997 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.075757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f64f5-4d00-4869-85df-d150b96fc997 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.076341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f64f5-4d00-4869-85df-d150b96fc997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.125644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-599f64f5-4d00-4869-85df-d150b96fc997 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:12.127749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-599f64f5-4d00-4869-85df-d150b96fc997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.155818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.156717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.156717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.157008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.157635 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.159367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.172334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1107/2221] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:12.176271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.178074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.203430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7816c88-4778-43ba-aef6-a98f4feac751 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.229239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.229910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.230208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.230994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] PATH_INFO: `/v3/projects/3dace80387994a51a8b4d399cf8b522d/users/4d6b5ebb189040cd9644abb6171b7f61/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.269611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dace80387994a51a8b4d399cf8b522d, user_id=4d6b5ebb189040cd9644abb6171b7f61, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.273363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1115/2222] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:12.275277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.282188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9b09-5cbf-4ed3-9634-8ded0699e01c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.282476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9b09-5cbf-4ed3-9634-8ded0699e01c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.282857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9b09-5cbf-4ed3-9634-8ded0699e01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.301825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1108/2223] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:12 2022] PUT /identity/v3/projects/3dace80387994a51a8b4d399cf8b522d/users/4d6b5ebb189040cd9644abb6171b7f61/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:29:12.305730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.316960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8d6a9b09-5cbf-4ed3-9634-8ded0699e01c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:12.317859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8d6a9b09-5cbf-4ed3-9634-8ded0699e01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.414231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489ce67-c709-4ab3-828d-3e87d9509ac5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.418026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1116/2224] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:12.419450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.419795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.420180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.424227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.425502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.425790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.426098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.426752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.428507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.443033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:12.444654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.445312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1109/2225] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:12.446606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.459621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f568-4671-408b-9838-f610c930a955 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.466703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.468205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.468776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:12.469592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.470149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.471056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:29:12.472050 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.474761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.487047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:12.498013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1110/2226] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:29:12.498912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.511363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b9dd-4bd1-4a91-8b9f-894975ae4e28 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.517003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.517718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.518084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.518374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] PATH_INFO: `/v3/projects/3dace80387994a51a8b4d399cf8b522d/users/4d6b5ebb189040cd9644abb6171b7f61/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.521060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dace80387994a51a8b4d399cf8b522d, user_id=4d6b5ebb189040cd9644abb6171b7f61, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.524109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e83927-68b0-4246-a251-9dc7d442d68c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.525679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1117/2227] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:12.526912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.537704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1111/2228] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:12 2022] PUT /identity/v3/projects/3dace80387994a51a8b4d399cf8b522d/users/4d6b5ebb189040cd9644abb6171b7f61/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:12.548322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.548850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.548850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.559928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443919a-d96c-4c5d-a213-aee889b81099 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.612868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] MFA Rules not processed for user `4d6b5ebb189040cd9644abb6171b7f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:12.614528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.672800 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.673592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.673942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.674421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.675134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.677140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.717118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1118/2229] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:12.718416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.723956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.729310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1112/2230] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:12.730890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.749832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e1b15-cb22-44df-a3f4-d6fb1c778213 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.844918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.845637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.845993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.846337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.847046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:12.850062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:12.855205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec119c-3fa0-4648-b2e9-e59409df9722 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.864864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:12.865902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:12.866741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:12.867907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:12.888283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1113/2231] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:12 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:12.890363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:12.892463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:12.993739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78208e-7ce0-4331-8863-600ac880fb7a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:12.996702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:13.002714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.004408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:13.005419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.005700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.006574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.009354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:13.011354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.035225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1119/2232] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:29:13.036272 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:13.051896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:13.063683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2491be-0aec-4dfb-948f-e74bb2cafb94 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:13.082336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:13.082975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.083243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.083504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.084173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.088857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.107346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1120/2233] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:13.116434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:13.137197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445833e-41c3-4c1c-a279-238c0a667967 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:13.149103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:13.150778 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.151073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.151328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.155737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.157590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.167609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.169071 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523cdcb-c028-4afa-bab0-6c8f9a44823f service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.192182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1121/2234] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:13.195827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:13.203597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1114/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:13.226296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d6a-e54d-4dcf-8640-99726ab20fa2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:13.238971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:13.239656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.239934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.240202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] PATH_INFO: `/v3/projects/5192a78d86bc40ae96a3cbb283992463/users/2aa5f23fe0ea4030b3858f3e5ccde8c1/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.287316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5192a78d86bc40ae96a3cbb283992463, user_id=2aa5f23fe0ea4030b3858f3e5ccde8c1, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.290712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.319558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1122/2236] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:13 2022] PUT /identity/v3/projects/5192a78d86bc40ae96a3cbb283992463/users/2aa5f23fe0ea4030b3858f3e5ccde8c1/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:13.325275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.326414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.326969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.388000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:13.391870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:13.566517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1115/2237] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:13.572231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:13.579628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:13.712731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429a4fe-f3de-4b5c-8ccf-f23c750833af admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:13.725863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:13.726867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:13.727316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:13.728367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:13.763429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:13.767124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:13.786574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1123/2238] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:15.198513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:15.202724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:15.318747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360906a-d7bf-4885-a3f9-d73931bcf280 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:15.322693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:15.323316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:15.323597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:15.323872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:15.326092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:15.411567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:15.413192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:15.424253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1116/2239] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:29:16.601531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:16.612565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c98fb-58bd-4652-a890-8a1e1611c4c2 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:16.624429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:16.625309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:16.625309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:16.625591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:16.726230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:16.728026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098229-6ed4-47f6-9de2-cb8eaffe55cf service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:16.755227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1124/2240] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:20.817898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:20.836577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a123c54-5566-408a-bf76-8d2f04406f80 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:20.867984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:20.869379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:20.869881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:20.870519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] PATH_INFO: `/v3/users/b382d9626c5e4b9989409ee81d07b8e1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:20.872178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b382d9626c5e4b9989409ee81d07b8e1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:20.875144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:20.881693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:20.969940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b382d9626c5e4b9989409ee81d07b8e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:20.972963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b382d9626c5e4b9989409ee81d07b8e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:20.994315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b382d9626c5e4b9989409ee81d07b8e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:20.995515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b382d9626c5e4b9989409ee81d07b8e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:21.018762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52bdfc53-664b-4757-b783-cd0cc8688594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b382d9626c5e4b9989409ee81d07b8e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:21.063041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1117/2241] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:20 2022] DELETE /identity/v3/users/b382d9626c5e4b9989409ee81d07b8e1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:21.067329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.067876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.067876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.131744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:21.133080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:21.148459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.148888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.149286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.198510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] MFA Rules not processed for user `2aa5f23fe0ea4030b3858f3e5ccde8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:21.199974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:21.252859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:21.292850 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1125/2242] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:21.313934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.316669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:21.397889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1118/2243] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:21.402390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.410525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:21.464294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f616-d8e9-4e0f-8d1b-8858a1be7484 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:21.471636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:21.472492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.473365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.473830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.474678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:21.477170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:21.501980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a9dc-5d35-43e9-99a0-bb37a7c23253 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:21.515838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:21.516443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.516731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.517002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.519472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1119/2244] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:21 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:21.526550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.540726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:21.542224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:21.568508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1126/2245] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:21.660601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:21.704939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814243f-520d-460c-8551-de68c35e38ce admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:21.714069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:21.714972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.716096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.716537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.728190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:21.731647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:21.786814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1120/2246] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:21 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:21.788937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.802334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f95a-352c-4c30-98ad-6d7a157ecb9e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:21.812066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:21.812725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.813010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.813280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.814079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:21.815728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:21.854278 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.854837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1127/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:21.869755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e57eb-27c1-42b5-8815-fb7dd039e583 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:21.889471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:21.892808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:21.893206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:21.893610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] PATH_INFO: `/v3/projects/bce6922c8d2d48acb9630463d132ef3c/users/616a531e57114b16bc9eaf2d8216c664/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:21.934372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce6922c8d2d48acb9630463d132ef3c, user_id=616a531e57114b16bc9eaf2d8216c664, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:21.943700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:21.968696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1121/2248] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:21 2022] PUT /identity/v3/projects/bce6922c8d2d48acb9630463d132ef3c/users/616a531e57114b16bc9eaf2d8216c664/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:29:21.972657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:21.994481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da29793-bbba-402f-9e26-a0caef027b20 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:22.135838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:22.137285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:22.137804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:22.138323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:22.139414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:22.141283 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:22.170805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1128/2249] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:29:22.171821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:22.183138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa728388-cf45-464d-ae75-b7c81f2c8006 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:22.213558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:22.214447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:22.214799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:22.215138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] PATH_INFO: `/v3/projects/bce6922c8d2d48acb9630463d132ef3c/users/616a531e57114b16bc9eaf2d8216c664/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:22.239985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce6922c8d2d48acb9630463d132ef3c, user_id=616a531e57114b16bc9eaf2d8216c664, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:22.243418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:22.284000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1122/2250] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:22 2022] PUT /identity/v3/projects/bce6922c8d2d48acb9630463d132ef3c/users/616a531e57114b16bc9eaf2d8216c664/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:22.363887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:22.372375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:22.421225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120252c-2268-4fef-a905-d24178b1c291 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:22.612243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:22.614413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:22.615279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:22.615756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] PATH_INFO: `/v3/projects/043779a089cd49f6b3b55df4542e4537` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:22.618571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=043779a089cd49f6b3b55df4542e4537)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:22.621560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:22.662604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:22.714749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043779a089cd49f6b3b55df4542e4537', 'request_id': 'req-993f9446-e658-462b-b45d-111b014e64bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:22.745337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043779a089cd49f6b3b55df4542e4537', 'request_id': 'req-993f9446-e658-462b-b45d-111b014e64bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:22.766243 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043779a089cd49f6b3b55df4542e4537', 'request_id': 'req-993f9446-e658-462b-b45d-111b014e64bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:22.793497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] The token cache is being invalidate because project 043779a089cd49f6b3b55df4542e4537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:22.794076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:22.794924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:22.797508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1129/2251] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:22 2022] DELETE /identity/v3/projects/043779a089cd49f6b3b55df4542e4537 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:22.801325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:22.803446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:22.821595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092972cb-5759-48f0-b740-b3159f29c21a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:22.984857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:22.985554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:22.985778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:22.986306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] PATH_INFO: `/v3/users/cf210314eafc4c479808e736f4102eeb` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:22.988281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf210314eafc4c479808e736f4102eeb)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:22.991274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:23.110548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf210314eafc4c479808e736f4102eeb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:23.111615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf210314eafc4c479808e736f4102eeb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:23.131270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf210314eafc4c479808e736f4102eeb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:23.132019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf210314eafc4c479808e736f4102eeb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:23.143103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf210314eafc4c479808e736f4102eeb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:23.163425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1123/2252] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:22 2022] DELETE /identity/v3/users/cf210314eafc4c479808e736f4102eeb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:23.926407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:23.956643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f9446-e658-462b-b45d-111b014e64bb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:24.099485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:24.100409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:24.100853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:24.101286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] PATH_INFO: `/v3/projects/586f1df9d193470397dfbdebe998fe9e` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:24.110564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586f1df9d193470397dfbdebe998fe9e)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:24.114162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:24.212173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586f1df9d193470397dfbdebe998fe9e', 'request_id': 'req-80380c31-1cc5-4549-8516-0c7dcc5b83f2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.221208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586f1df9d193470397dfbdebe998fe9e', 'request_id': 'req-80380c31-1cc5-4549-8516-0c7dcc5b83f2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.237903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586f1df9d193470397dfbdebe998fe9e', 'request_id': 'req-80380c31-1cc5-4549-8516-0c7dcc5b83f2'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.266228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] The token cache is being invalidate because project 586f1df9d193470397dfbdebe998fe9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:24.266530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.268487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.273011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1130/2253] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:23 2022] DELETE /identity/v3/projects/586f1df9d193470397dfbdebe998fe9e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:24.276796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:24.279221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:24.307624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412430-f939-4935-9293-9f63073ffcbf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:24.354093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:24.442778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:24.443308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:24.443594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:24.443869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] PATH_INFO: `/v3/users/4d6b5ebb189040cd9644abb6171b7f61` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:24.447716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6b5ebb189040cd9644abb6171b7f61)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:24.449700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:24.643068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6b5ebb189040cd9644abb6171b7f61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.643068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6b5ebb189040cd9644abb6171b7f61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.696306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6b5ebb189040cd9644abb6171b7f61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.698966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6b5ebb189040cd9644abb6171b7f61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.722197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9e62e82e-7812-46bb-8542-7671ed344ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6b5ebb189040cd9644abb6171b7f61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:24.750087 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1124/2254] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:24 2022] DELETE /identity/v3/users/4d6b5ebb189040cd9644abb6171b7f61 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:25.657245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:25.661837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:25.697905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80380c31-1cc5-4549-8516-0c7dcc5b83f2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:25.793996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:25.863727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:25.863727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:25.863727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:25.863727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] PATH_INFO: `/v3/projects/3dace80387994a51a8b4d399cf8b522d` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:25.864230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dace80387994a51a8b4d399cf8b522d)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:25.865461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:25.978488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dace80387994a51a8b4d399cf8b522d', 'request_id': 'req-13877397-7a42-40cc-890b-22e9fcc987db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:25.990652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dace80387994a51a8b4d399cf8b522d', 'request_id': 'req-13877397-7a42-40cc-890b-22e9fcc987db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:26.006453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dace80387994a51a8b4d399cf8b522d', 'request_id': 'req-13877397-7a42-40cc-890b-22e9fcc987db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:26.028984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] The token cache is being invalidate because project 3dace80387994a51a8b4d399cf8b522d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:26.029830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:26.034829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-13877397-7a42-40cc-890b-22e9fcc987db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:26.036718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1131/2255] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:25 2022] DELETE /identity/v3/projects/3dace80387994a51a8b4d399cf8b522d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:26.042270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.042781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.042884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.079703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:26.082874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:26.206284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1125/2256] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:26.215015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.215300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.215625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.254468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:26.255737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:26.278014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1132/2257] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:26.283429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.297150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abe9a-c7ca-4194-839e-b1b1d9364826 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.311676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.312315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.312592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.312863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.313525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:29:26.313826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.317687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.358707 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1126/2258] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:29:26.363814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.375832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e1d2d-2e6d-475e-acc7-6bb2eafe4d0e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.386020 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.386989 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.392540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.393685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.394638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.399206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.465783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1133/2259] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:29:26 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:26.470208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.481719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640387d9-718c-4e0b-b62f-ba6a450b71d0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.556147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:26.636309 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.636954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.637254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.637523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.638185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.640697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.686973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1127/2260] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:29:26 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:29:26.690804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.707688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031152-b5df-46cd-8d5d-a1938803cac7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.720204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.721106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.721590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.722111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.723006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.727933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.755459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1134/2261] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:29:26.758423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.775998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4de8-e1ad-4828-8e41-ecd73a46bec4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.785361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.786162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.786542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.786914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.787688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.789430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd2f0e-53bf-4480-8809-f98727336cc3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.819978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:26.820654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1128/2262] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:29:26.834175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b542e-8a04-488e-9851-89b79f348f95 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:26.849361 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:26.851785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.852179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.852579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] PATH_INFO: `/v3/projects/7ae7556a2c7849d6b3fed686f78857cc/users/930495f1b6a84d7f8c80796a4f832f86/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:26.893725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae7556a2c7849d6b3fed686f78857cc, user_id=930495f1b6a84d7f8c80796a4f832f86, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:26.900532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:26.940388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1135/2263] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:29:26 2022] PUT /identity/v3/projects/7ae7556a2c7849d6b3fed686f78857cc/users/930495f1b6a84d7f8c80796a4f832f86/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:26.950848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:26.951202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:26.951994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:27.014677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] MFA Rules not processed for user `930495f1b6a84d7f8c80796a4f832f86`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:27.015909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:27.191986 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1129/2264] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:27.212944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:27.214998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:27.377351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dad792-f1e8-4d6e-a944-f4e9a0c5e78c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:27.401125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:27.402296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:27.403005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:27.403527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:27.416076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:27.420425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5e4ba-a178-4109-a9be-c089d3daf8f8 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:27.450594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1136/2265] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:30.519835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:30.614478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb2a4d-2987-4a1e-82b1-adc170243386 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:30.619767 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:30.620476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:30.620964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:30.621458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] PATH_INFO: `/v3/users/930495f1b6a84d7f8c80796a4f832f86` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:30.632553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930495f1b6a84d7f8c80796a4f832f86)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:30.640318 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:30.706173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:30.730156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930495f1b6a84d7f8c80796a4f832f86'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:30.730982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930495f1b6a84d7f8c80796a4f832f86'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:30.752773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930495f1b6a84d7f8c80796a4f832f86'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:30.754047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930495f1b6a84d7f8c80796a4f832f86'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:30.775375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930495f1b6a84d7f8c80796a4f832f86'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:30.814011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1130/2266] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:29:30 2022] DELETE /identity/v3/users/930495f1b6a84d7f8c80796a4f832f86 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:30.817648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3593-a23a-4d0e-b058-62fe6c0a5cdd None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:30.818123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3593-a23a-4d0e-b058-62fe6c0a5cdd None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:30.818299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3593-a23a-4d0e-b058-62fe6c0a5cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:30.831281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:30.881081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-039d3593-a23a-4d0e-b058-62fe6c0a5cdd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:30.885035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-039d3593-a23a-4d0e-b058-62fe6c0a5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:31.067669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1137/2267] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:31.074545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:31.077359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:31.260537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8a2a5-ed5f-4371-b448-61d6df328a73 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:31.273041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:31.274710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:31.275001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:31.275280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:31.322721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:31.324205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:31.352024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1131/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:31.475736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:31.476441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:31.476936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:31.548441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] MFA Rules not processed for user `616a531e57114b16bc9eaf2d8216c664`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:31.553904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:31.718884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1138/2269] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:31.727120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:31.729694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:31.897020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d59c87-a793-4128-b7f9-467da5cb2fb2 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:31.902362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:31.903065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:31.903501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:31.903844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:31.906619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:32.029047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:32.030780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:32.031290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddcebf-2916-4634-8ec3-9d483a30aed7 service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:32.033232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:32.042493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1132/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:32.060099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc67e4-6b41-4ce1-8bf4-26e92b6fde63 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:32.075211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:32.077159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:32.077440 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:32.077714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] PATH_INFO: `/v3/projects/7ae7556a2c7849d6b3fed686f78857cc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:32.090349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae7556a2c7849d6b3fed686f78857cc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:32.094873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:32.212437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae7556a2c7849d6b3fed686f78857cc', 'request_id': 'req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:32.221032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae7556a2c7849d6b3fed686f78857cc', 'request_id': 'req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:32.275899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae7556a2c7849d6b3fed686f78857cc', 'request_id': 'req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:32.304615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:32.305121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:32.305537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:32.370151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:32.371469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:32.379889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:32.384947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] The token cache is being invalidate because project 7ae7556a2c7849d6b3fed686f78857cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:29:32.385246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:32.395813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:29:32.417991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1139/2271] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:29:32 2022] DELETE /identity/v3/projects/7ae7556a2c7849d6b3fed686f78857cc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:29:32.553266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1133/2272] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:29:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:29:32.561172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:32.563972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:32.613472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:32.740538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2fb82-f60c-4051-bdc6-0e5169d8ed7d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:32.746148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:32.746884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:32.747262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:32.748460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:32.767229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:32.769152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016838-ec21-4c13-9d46-45ee53dedb7e service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:32.785054 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1140/2273] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:29:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:29:37.698568 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:37.700033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:37.774410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c6e0-8e21-4eaf-b5e4-267b5e155aef None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:37.780110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:37.780936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:37.781414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:37.781890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:37.784223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:37.877160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:37.880747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6648c1-a386-497f-be9a-2b88a93d4b12 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:37.892643 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1134/2274] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:41.444330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.444913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.444913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.446400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1141/2275] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:29:41.455226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6feb7-be72-46d8-93c4-5ead638e7bfe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.455816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6feb7-be72-46d8-93c4-5ead638e7bfe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.455816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6feb7-be72-46d8-93c4-5ead638e7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.482026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-64e6feb7-be72-46d8-93c4-5ead638e7bfe None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:41.485454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-64e6feb7-be72-46d8-93c4-5ead638e7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:41.581671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:41.615183 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1135/2276] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:29:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:41.632725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:41.639422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:41.775186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e69bd-61c3-40d1-b4cd-385dba25f4b9 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:41.779804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:41.780472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.780902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.781311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.796078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:41.800899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed58087-d0ee-46b1-8532-899bc9768009 service glance] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:41.831028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1142/2277] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:41.905926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be52d-946b-4a00-9858-1f77a90ddf35 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.906241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be52d-946b-4a00-9858-1f77a90ddf35 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.906499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86be52d-946b-4a00-9858-1f77a90ddf35 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.908399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1136/2278] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:29:41.916152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523f88-05d2-4920-9bc4-8754464080f6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.916672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523f88-05d2-4920-9bc4-8754464080f6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.917036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d523f88-05d2-4920-9bc4-8754464080f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.944153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3d523f88-05d2-4920-9bc4-8754464080f6 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:41.945533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3d523f88-05d2-4920-9bc4-8754464080f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:41.954692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1143/2279] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:29:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:41.969037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be52d-946b-4a00-9858-1f77a90ddf35 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:41.981846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86be52d-946b-4a00-9858-1f77a90ddf35 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:41.985569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:41.986295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:41.986630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:41.986977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:41.995883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:41.997386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561c1ae-1202-47d6-9b45-87078cd255d9 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:42.009800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1137/2280] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:42.105723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b936-bbe0-4391-9972-9ee0690c3a97 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:42.106066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b936-bbe0-4391-9972-9ee0690c3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:42.106318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6b936-bbe0-4391-9972-9ee0690c3a97 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:42.107934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1144/2281] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:29:42.115490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead11e-3b6c-4511-8d3d-8b5fef45d791 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:42.115863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead11e-3b6c-4511-8d3d-8b5fef45d791 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:42.116213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead11e-3b6c-4511-8d3d-8b5fef45d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:42.143272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0cead11e-3b6c-4511-8d3d-8b5fef45d791 None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:42.145234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0cead11e-3b6c-4511-8d3d-8b5fef45d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:42.155297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1138/2282] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:29:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:42.167908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6b936-bbe0-4391-9972-9ee0690c3a97 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:42.181591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6b936-bbe0-4391-9972-9ee0690c3a97 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:42.185826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:42.186466 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:42.186867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:42.187147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:42.200501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:42.202184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef599154-7e37-4e2d-b370-6078408a525a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:42.216198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1145/2283] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:44.467225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:44.467833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:44.467833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:44.496849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] MFA Rules not processed for user `2aa5f23fe0ea4030b3858f3e5ccde8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:44.497734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:44.557475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1139/2284] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:29:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:45.834814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:45.835352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:45.835555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:45.855008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:45.856223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:45.863630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1146/2285] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:29:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:45.877716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:45.890636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ac44-cb56-4aac-98a9-ade0679aa3da None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:45.895993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:45.896590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:45.896865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:45.897133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:45.905392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:45.906935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3a19-4af1-45b1-afe4-013ca2c94162 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:45.914942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1140/2286] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:29:55.850347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=64 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:55.911686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=41 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:29:57.948089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:57.951477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:58.035130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9072cf-a071-4583-aff4-c748f38dea7d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:58.040652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:58.041502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:58.041843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:58.042409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:58.045502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:58.059005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:58.060931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:58.077733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1147/2287] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:29:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:29:58.123148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250a40-eb10-4e30-b083-cb6d66016cd1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:58.123685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250a40-eb10-4e30-b083-cb6d66016cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:58.123790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250a40-eb10-4e30-b083-cb6d66016cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:58.151253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78250a40-eb10-4e30-b083-cb6d66016cd1 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:29:58.152640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78250a40-eb10-4e30-b083-cb6d66016cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:29:58.171129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1141/2288] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:29:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:29:58.184475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:29:58.197204 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d9f11-10bb-4904-aaba-962c1e1b1555 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:29:58.202593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:29:58.203214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:29:58.203495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:29:58.203766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:29:58.214212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:29:58.215853 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:29:58.226747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1148/2289] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:30:08.143843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:08.222649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=38 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:16.408036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:30:16.408660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:30:16.408660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:30:16.427948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:30:16.429154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:30:16.436320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1142/2290] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:30:16.458934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:30:16.469589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c65482-8b5c-45b3-9a9a-e4fce900c5ae service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:30:16.475848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:30:16.476450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:30:16.476722 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:30:16.476987 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:30:16.485228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:30:16.487372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ae0c3-b243-4872-8ad7-53bf1dbace64 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:30:16.495510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1149/2291] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:30:26.422125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:26.492419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=6 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:33.440055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:30:33.450844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec06a1-9a83-49cf-973c-9141bf365fe5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:30:33.461016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:30:33.461344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:30:33.462361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:30:33.462642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:30:33.464835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:30:33.557575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:30:33.559156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a99b8-c2db-4b1b-a884-4eb30a7fa220 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:30:33.569861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1143/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:30:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:30:38.452247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e857-ba33-47b1-a075-634a95b99031 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:30:38.452680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e857-ba33-47b1-a075-634a95b99031 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:30:38.452789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620e857-ba33-47b1-a075-634a95b99031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:30:38.490146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5620e857-ba33-47b1-a075-634a95b99031 None None] MFA Rules not processed for user `be489ecec19847829df7c4488986373e`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:30:38.491297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5620e857-ba33-47b1-a075-634a95b99031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:30:38.620430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1150/2293] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:30:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:30:43.564974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=30 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:48.611352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=25 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:30:49.592789 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:30:49.593291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:30:49.593291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:30:49.613310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] MFA Rules not processed for user `f8b0c96c80db4db4a477a1fa6c1fa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:30:49.614627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:30:49.668627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1144/2294] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:30:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:30:59.662253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=25 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:13.227603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:13.228155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:13.228155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:13.248777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] MFA Rules not processed for user `21e14b8bcd4442168c2d1b7cfc956dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:13.250238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:13.306671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1151/2295] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:23.299848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=25 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:44.139533 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:44.140975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:44.152820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8e7c-e34d-4bd4-b00d-957e674fcfa1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:44.156518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:44.157124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:44.157404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:44.157678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:44.159467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:44.173033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:44.175164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:44.186140 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1145/2296] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:45.353820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:45.363918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06080-ad16-4b73-a370-de47cdfea6de None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:45.367689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:45.368286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:45.368557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:45.368823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:45.370530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:45.432446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:45.433874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:45.444012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1152/2297] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:48.550778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:48.552527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:48.569095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f8c0e-57e6-494e-82ea-8a8615397499 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:48.581353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:48.582058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:48.582346 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:48.582620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] PATH_INFO: `/v3/users/be489ecec19847829df7c4488986373e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:48.584736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be489ecec19847829df7c4488986373e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:48.586958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:48.635909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be489ecec19847829df7c4488986373e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.636572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be489ecec19847829df7c4488986373e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.649867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be489ecec19847829df7c4488986373e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.650670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be489ecec19847829df7c4488986373e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.660078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-277c9c3a-75a1-4bfb-af42-9528c7957522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be489ecec19847829df7c4488986373e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.672357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1146/2298] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:31:48 2022] DELETE /identity/v3/users/be489ecec19847829df7c4488986373e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:48.844865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:48.854909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1df420-e1ee-4976-8441-02e85bc8d57e service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:48.914270 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:48.914902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:48.915176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:48.915445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] PATH_INFO: `/v3/projects/177d0707c9d1494abc77c714e31fa15f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:48.916538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177d0707c9d1494abc77c714e31fa15f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:48.918486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:48.964946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177d0707c9d1494abc77c714e31fa15f', 'request_id': 'req-ed395d28-9b88-4781-bb48-02e2660ec551'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.970312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177d0707c9d1494abc77c714e31fa15f', 'request_id': 'req-ed395d28-9b88-4781-bb48-02e2660ec551'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.977019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177d0707c9d1494abc77c714e31fa15f', 'request_id': 'req-ed395d28-9b88-4781-bb48-02e2660ec551'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.987787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] The token cache is being invalidate because project 177d0707c9d1494abc77c714e31fa15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:31:48.988135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.988769 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ed395d28-9b88-4781-bb48-02e2660ec551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:48.990297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1153/2299] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:31:48 2022] DELETE /identity/v3/projects/177d0707c9d1494abc77c714e31fa15f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:48.996422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:48.996711 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:48.996987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.016424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:49.018276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:49.074506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1147/2300] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:49.083685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce675-c843-45c6-a656-835c869a7dba None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.083966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce675-c843-45c6-a656-835c869a7dba None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.084236 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ce675-c843-45c6-a656-835c869a7dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.103351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-276ce675-c843-45c6-a656-835c869a7dba None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:49.104469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-276ce675-c843-45c6-a656-835c869a7dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:49.112760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1154/2301] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:49.116791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.126600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f5a0-a74f-44a9-a34c-f638b51e7a2a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.131703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.132287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.132557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.132825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.133448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:31:49.133740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.135510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.146620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1148/2302] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:31:49.150884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ce675-c843-45c6-a656-835c869a7dba None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.160006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ce675-c843-45c6-a656-835c869a7dba None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.164785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.165377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.165648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.165914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.166565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.168516 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.184458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:49.200395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1155/2303] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:31:49.201514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.211378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8a2c3-ec74-40ec-8287-d72c5caa5905 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.254637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:49.268455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.269047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.269326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.269594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.270236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.272135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.292531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1149/2304] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:31:49.296598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.307628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2aee1a-fc72-40bd-afcb-d28b481c0f79 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.312467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.313070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.313349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.313622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.314445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.316701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.326880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1156/2305] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:49.330905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.341185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b0278-7a67-4a5d-99a5-f32895c18d6b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.350368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.350368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.350368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.350368 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.351281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.351281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647a037-a1a2-4b06-bd8c-30a3eaa85fe9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.368546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1150/2306] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:49.369680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.383365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c52a-1e76-4b2e-abe7-d257580aae49 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.388575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.389293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.389632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.390087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] PATH_INFO: `/v3/projects/187642b21d9f47f488ba5eb62111f7d6/users/e5d6c5a54f27428d9658e8cb6827ce83/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.405460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187642b21d9f47f488ba5eb62111f7d6, user_id=e5d6c5a54f27428d9658e8cb6827ce83, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.408292 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.421303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1157/2307] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:49 2022] PUT /identity/v3/projects/187642b21d9f47f488ba5eb62111f7d6/users/e5d6c5a54f27428d9658e8cb6827ce83/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:49.431758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.432047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.432322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.459764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] MFA Rules not processed for user `e5d6c5a54f27428d9658e8cb6827ce83`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:49.460970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:49.531617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1151/2308] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:31:49.536836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.605603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3fd3-f66b-4c00-a66d-ec8e9d5db3a7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.612384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.613194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.613628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.613896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.614568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.616538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.650331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1158/2309] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:31:49.654704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.667881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5013c-33e0-4b6b-8275-2d63dfcf499c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.724352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.724963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.725246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.725519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.726176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.728089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.749052 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1152/2310] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:31:49.753083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.763422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71079ee0-fdd7-486d-8141-d89fa324cc6e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.767999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.768585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.768862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.769131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.769767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.771407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.781841 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1159/2311] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:49.786555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.796331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478479f-4065-4dc2-9ea0-97127cfd09d8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.801677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.802354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.802630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.802896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] PATH_INFO: `/v3/projects/f9360634a03c45c59f18d514375c0b08/users/0ad6f5ecd5034527bc904d0c2df116cc/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.817164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9360634a03c45c59f18d514375c0b08, user_id=0ad6f5ecd5034527bc904d0c2df116cc, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.819820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.833569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1153/2312] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:49 2022] PUT /identity/v3/projects/f9360634a03c45c59f18d514375c0b08/users/0ad6f5ecd5034527bc904d0c2df116cc/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:49.837493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.847917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932aad0-e91f-47ef-b7b2-63295ae8e278 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.905687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.906250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.906527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.906794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.907468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.909681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a86a03-622d-4a57-adf2-da15eba8f912 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.919245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1160/2313] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:49.923523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:49.933541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773115ec-dcdd-46ea-b3ae-217b8be393ed admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:49.938096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:49.938724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.938997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.939263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] PATH_INFO: `/v3/projects/f9360634a03c45c59f18d514375c0b08/users/0ad6f5ecd5034527bc904d0c2df116cc/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.941113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9360634a03c45c59f18d514375c0b08, user_id=0ad6f5ecd5034527bc904d0c2df116cc, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:49.943757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:49.953485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1154/2314] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:49 2022] PUT /identity/v3/projects/f9360634a03c45c59f18d514375c0b08/users/0ad6f5ecd5034527bc904d0c2df116cc/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:31:49.965285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:49.965600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:49.965888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:49.993805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] MFA Rules not processed for user `0ad6f5ecd5034527bc904d0c2df116cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:49.995030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:50.013073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:50.062958 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1161/2315] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:50.074510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:50.076167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:50.086329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:50.134291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992bed7-3692-482f-98f4-3c4371f5f338 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:50.137867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:50.138482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:50.138753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:50.139017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:50.148173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:50.149590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:50.159514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1155/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:50.239812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:50.249602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c9e98-ed45-4365-bb74-a2e63eb07f5e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:50.253731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:50.254350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:50.254623 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:50.254887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:50.311421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:50.312867 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:50.322205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1162/2317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:52.796164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:52.797561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:52.852890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ecd0b-a20a-4d6d-8513-a8c6e13f1db2 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:52.856435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:52.857022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:52.857297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:52.857562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:52.859230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:52.930359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:52.931771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9442d59-a07e-4dc8-be5e-ac6dc21bf176 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:52.943391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1156/2318] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:55.063184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:55.130873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c701bf-d03a-4797-a535-491f3db8b0b1 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:55.135701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:55.136396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.136862 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.137138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] PATH_INFO: `/v3/users/e5d6c5a54f27428d9658e8cb6827ce83` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.138302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d6c5a54f27428d9658e8cb6827ce83)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:55.140229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:55.192587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d6c5a54f27428d9658e8cb6827ce83'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.193255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d6c5a54f27428d9658e8cb6827ce83'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.200612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:55.207007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d6c5a54f27428d9658e8cb6827ce83'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.213790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d6c5a54f27428d9658e8cb6827ce83'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.223180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a2abbc9d-b504-472d-9c7d-da4fddc62dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d6c5a54f27428d9658e8cb6827ce83'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.229040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1163/2319] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:31:55 2022] DELETE /identity/v3/users/e5d6c5a54f27428d9658e8cb6827ce83 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:55.233353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.233805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.233926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.254973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:55.256176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:55.316466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:55.334082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.337434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.337556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1157/2320] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:31:55.337665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.346085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:55.347945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:55.364014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] MFA Rules not processed for user `b2e79830079c4aa9b95c4622bac45c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:55.365225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:55.411357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d57bc-077c-4ec1-992e-78aed1986e18 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:55.415122 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:55.415716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.415987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.416254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.425753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:55.427403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:55.427524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1164/2321] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:31:55.440938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1158/2322] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:55.714542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:55.716098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:55.733122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f617a-8074-4b6f-986f-8a94a077ab19 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:55.739246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:55.739992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.740143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.740416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] PATH_INFO: `/v3/projects/187642b21d9f47f488ba5eb62111f7d6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.741568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=187642b21d9f47f488ba5eb62111f7d6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:55.743829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:55.795598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187642b21d9f47f488ba5eb62111f7d6', 'request_id': 'req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.803114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187642b21d9f47f488ba5eb62111f7d6', 'request_id': 'req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.810437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187642b21d9f47f488ba5eb62111f7d6', 'request_id': 'req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.822211 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] The token cache is being invalidate because project 187642b21d9f47f488ba5eb62111f7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:31:55.822497 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.823122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.824609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1165/2323] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:31:55 2022] DELETE /identity/v3/projects/187642b21d9f47f488ba5eb62111f7d6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:55.828581 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:55.838720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0037bd-b5ea-4b80-ab2c-37d5c6ceaf03 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:55.900385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:55.900872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:55.901157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:55.902127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] PATH_INFO: `/v3/users/0ad6f5ecd5034527bc904d0c2df116cc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:55.902763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad6f5ecd5034527bc904d0c2df116cc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:55.905270 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:55.956998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad6f5ecd5034527bc904d0c2df116cc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.957644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad6f5ecd5034527bc904d0c2df116cc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.969794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad6f5ecd5034527bc904d0c2df116cc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.971226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad6f5ecd5034527bc904d0c2df116cc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.978805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6336be32-d405-4dd2-a055-bf0923f3722f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad6f5ecd5034527bc904d0c2df116cc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:55.991541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1159/2324] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:31:55 2022] DELETE /identity/v3/users/0ad6f5ecd5034527bc904d0c2df116cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:56.301831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.303512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:56.317983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd366f-0bf5-42df-b5d9-62455e5b7e3f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.387720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.388360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.388659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.388938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] PATH_INFO: `/v3/projects/f9360634a03c45c59f18d514375c0b08` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.390531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9360634a03c45c59f18d514375c0b08)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.392738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.395355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:56.448073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9360634a03c45c59f18d514375c0b08', 'request_id': 'req-f70612e2-f13e-406c-8620-b2c325a923c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:56.453585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9360634a03c45c59f18d514375c0b08', 'request_id': 'req-f70612e2-f13e-406c-8620-b2c325a923c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:56.462148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9360634a03c45c59f18d514375c0b08', 'request_id': 'req-f70612e2-f13e-406c-8620-b2c325a923c5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:56.473905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] The token cache is being invalidate because project f9360634a03c45c59f18d514375c0b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:31:56.474250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:56.474938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f70612e2-f13e-406c-8620-b2c325a923c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:56.476453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1166/2325] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:31:56 2022] DELETE /identity/v3/projects/f9360634a03c45c59f18d514375c0b08 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:56.481569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.482043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.482249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.503325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:56.504517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:56.513059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:56.569595 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1160/2326] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:56.577692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.578006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.578286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.599433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:56.600641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:56.608715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1167/2327] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:56.612990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.622859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328fe6-ffca-4e45-96fd-b13904eb428e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.627469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.628059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.628336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.628607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.629245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:31:56.629543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.631171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.642961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1161/2328] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:31:56.647275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.656424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b5a21-a388-4f2d-8072-14e15448f20d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.661669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.662285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.662558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.662824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.663443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.665327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.692123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1168/2329] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:31:56.696164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.706680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde29-5a04-4f4d-9598-7b44ccb1823e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.760951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.761547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.761850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.762154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.762780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.764717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.787078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1162/2330] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:31:56 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:31:56.791158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.801267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae942dc5-86b7-4782-a9ab-b25fc615bbf5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.805796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.806403 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.806669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.806940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.807566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.809136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.818940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1169/2331] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:56.822682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.832873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee876873-0c47-473c-96b4-9d9f06df79f7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.837532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.838165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.838448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.838719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.839374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.840927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6437e7-658e-45fd-aff5-4e02bb814e52 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.852575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1163/2332] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:56.856417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:56.868661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f17d43-a369-4031-98be-f6c0b7359ff8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:56.873296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:56.873943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.874244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.874515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] PATH_INFO: `/v3/projects/45f9e9f861cd4f0da47d088c32821637/users/ef7c91db2e2a4b10912b868b4fcb7d60/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.891950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f9e9f861cd4f0da47d088c32821637, user_id=ef7c91db2e2a4b10912b868b4fcb7d60, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:56.895307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:56.909060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1170/2333] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:56 2022] PUT /identity/v3/projects/45f9e9f861cd4f0da47d088c32821637/users/ef7c91db2e2a4b10912b868b4fcb7d60/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:56.919370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:56.919651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:56.919921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:56.948930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] MFA Rules not processed for user `ef7c91db2e2a4b10912b868b4fcb7d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:56.950168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:57.016359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1164/2334] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:57.021397 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.080421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5ce7f-0b66-4f17-883c-5f64773502b7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.085008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.085595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.085873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.086169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.086773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.088650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.113584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1171/2335] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:31:57 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:31:57.117861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.128885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273483-8fe6-4cc0-a3df-e22903296ebb None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.133416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:57.185947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.186569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.186855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.187112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.187746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.190203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.211133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1165/2336] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:31:57 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:31:57.215216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.225780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda4586-ac27-4913-bbcc-8f49036569a2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.230757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.231358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.231636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.231901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.232538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.234172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.245763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1172/2337] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:57.250230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.262168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd1513-ba61-4f86-b81f-af980d44ca43 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.268561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.269638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.270081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.270478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] PATH_INFO: `/v3/projects/918270a690e747daae86e5350470b86a/users/0aa4a219f0354c429e3b758ef3eb7830/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.287269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918270a690e747daae86e5350470b86a, user_id=0aa4a219f0354c429e3b758ef3eb7830, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.290282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.314679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1166/2338] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:57 2022] PUT /identity/v3/projects/918270a690e747daae86e5350470b86a/users/0aa4a219f0354c429e3b758ef3eb7830/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:57.316031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.322368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:57.331209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334eae4-222e-4733-b6c3-0d0f6aa2dcde admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.409592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.410233 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.410506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.410773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.411409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.413010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ea0f2-0760-4325-aad8-569a0d04acfa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.424044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1173/2339] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:31:57.428256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.440320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4371c-8c86-442e-9baf-4e7161760f47 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.445033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.445681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.445982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.446266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] PATH_INFO: `/v3/projects/918270a690e747daae86e5350470b86a/users/0aa4a219f0354c429e3b758ef3eb7830/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.448178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918270a690e747daae86e5350470b86a, user_id=0aa4a219f0354c429e3b758ef3eb7830, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.450925 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.461924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1167/2340] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:31:57 2022] PUT /identity/v3/projects/918270a690e747daae86e5350470b86a/users/0aa4a219f0354c429e3b758ef3eb7830/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:57.473410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.473695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.473994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.505564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] MFA Rules not processed for user `0aa4a219f0354c429e3b758ef3eb7830`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:57.506929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:57.575438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1174/2341] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:57.586953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.588823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:57.666484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18413088-5b2b-494b-9a0c-a18e0aa5ec11 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.670772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.671557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.671945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.672409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.695904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.697701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.708863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1168/2342] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:57.793690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:57.795256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:57.808625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a1d89-6c55-4fe7-90bf-c43357c1ff40 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:57.812966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:57.813643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:57.814209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:57.814458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:57.876427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:57.877993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb41fd-735c-4903-843d-999e189e5118 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:57.893932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1175/2343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:58.282700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:58.358127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4783de7-2c1d-4df7-9006-0ffcfb7fe2c8 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:58.363372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:58.364136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:58.364415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:58.364688 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] PATH_INFO: `/v3/users/ef7c91db2e2a4b10912b868b4fcb7d60` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:58.365886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7c91db2e2a4b10912b868b4fcb7d60)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:58.368107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:58.373128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:58.432002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7c91db2e2a4b10912b868b4fcb7d60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:58.432816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7c91db2e2a4b10912b868b4fcb7d60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:58.447786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7c91db2e2a4b10912b868b4fcb7d60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:58.448577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7c91db2e2a4b10912b868b4fcb7d60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:58.456772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7c91db2e2a4b10912b868b4fcb7d60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:58.469898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1169/2344] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:31:58 2022] DELETE /identity/v3/users/ef7c91db2e2a4b10912b868b4fcb7d60 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:58.474275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:58.474813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:58.474813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:58.522609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:31:58.524193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:58.558893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:58.636381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1176/2345] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:31:58.660045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:58.661654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:58.738299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f60d66-9a66-4eb8-9f80-019c49b0609d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:58.742626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:58.743249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:58.743534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:58.743807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:58.754732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:58.756425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:58.768084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1170/2346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:31:59.378088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:59.379940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:59.395576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6143d-cc3e-4a17-ab6f-6ecc3ecc9620 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:59.401342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:59.402332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:59.402457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:59.402677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] PATH_INFO: `/v3/projects/45f9e9f861cd4f0da47d088c32821637` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:59.404057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f9e9f861cd4f0da47d088c32821637)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:59.406342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:59.474209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f9e9f861cd4f0da47d088c32821637', 'request_id': 'req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.484146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f9e9f861cd4f0da47d088c32821637', 'request_id': 'req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.494898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f9e9f861cd4f0da47d088c32821637', 'request_id': 'req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.508957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] The token cache is being invalidate because project 45f9e9f861cd4f0da47d088c32821637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:31:59.509259 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.509900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.511636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1177/2347] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:31:59 2022] DELETE /identity/v3/projects/45f9e9f861cd4f0da47d088c32821637 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:31:59.516049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:59.526697 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc809-0e6e-4386-8089-c2b4330d2e67 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:31:59.586151 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:31:59.586949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:31:59.587230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:31:59.587502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] PATH_INFO: `/v3/users/0aa4a219f0354c429e3b758ef3eb7830` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:31:59.588647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa4a219f0354c429e3b758ef3eb7830)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:31:59.591744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:31:59.629344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:31:59.650793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa4a219f0354c429e3b758ef3eb7830'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.651535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa4a219f0354c429e3b758ef3eb7830'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.665859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa4a219f0354c429e3b758ef3eb7830'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.666961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa4a219f0354c429e3b758ef3eb7830'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.675028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-10ed828f-2fd1-4fb0-86af-ef70cc88be60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa4a219f0354c429e3b758ef3eb7830'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:31:59.687288 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1171/2348] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:31:59 2022] DELETE /identity/v3/users/0aa4a219f0354c429e3b758ef3eb7830 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:31:59.959037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:31:59.960483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:31:59.973706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5f4c-c45b-4770-8a98-ba240a31b7e5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.031289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.031910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.032185 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.032453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] PATH_INFO: `/v3/projects/918270a690e747daae86e5350470b86a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.033556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918270a690e747daae86e5350470b86a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.035495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.079281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:00.081141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918270a690e747daae86e5350470b86a', 'request_id': 'req-30e81bd7-6b3c-4c6b-af16-46d232572023'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.088120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918270a690e747daae86e5350470b86a', 'request_id': 'req-30e81bd7-6b3c-4c6b-af16-46d232572023'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.094911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918270a690e747daae86e5350470b86a', 'request_id': 'req-30e81bd7-6b3c-4c6b-af16-46d232572023'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.105551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] The token cache is being invalidate because project 918270a690e747daae86e5350470b86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:00.105833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.106471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-30e81bd7-6b3c-4c6b-af16-46d232572023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.107916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1178/2349] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:31:59 2022] DELETE /identity/v3/projects/918270a690e747daae86e5350470b86a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:00.112869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.113148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.113414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.133150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:00.134763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:00.193771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1172/2350] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:00.201917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.202237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.202510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.222704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:00.223919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:00.231732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1179/2351] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:00.235870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.245851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c6ed-dcd0-420c-b5c4-f69f6c6f3b37 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.250434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.251033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.251313 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.252110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.252754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:32:00.253055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.254676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.266519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1173/2352] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:32:00.271417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.280605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019b0a-fa7d-42ca-a854-a13fb857e34d None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.285224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.285807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.286188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.286459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.287083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.288975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.315901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1180/2353] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:00.320124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.330756 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803654f5-a8b9-4bd4-bcf5-9a955273e557 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.387121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.387651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.387930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.388197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.388813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.390920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.411726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1174/2354] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:00.415983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.427036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af31bf0-2a3b-4238-a693-a0350ed5638a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.431858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.432454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.432729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.432996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.433659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.435303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.445648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1181/2355] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:00.449534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.460185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77806e94-3094-4a62-833e-292dddc55085 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.464865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.465450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.465727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.466021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.466659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.468247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612dedb-405a-48fd-872f-83d0dde40bb6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.479663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1175/2356] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:00.483622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.494317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836db329-6566-4480-a70b-3f2d13bc6f76 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.499048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.499683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.499960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.500229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] PATH_INFO: `/v3/projects/484f17d385af4ac0ad393f1a1253f760/users/b3da70a0bf52427baefed900ca926593/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.515182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484f17d385af4ac0ad393f1a1253f760, user_id=b3da70a0bf52427baefed900ca926593, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.517818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.530434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1182/2357] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:32:00 2022] PUT /identity/v3/projects/484f17d385af4ac0ad393f1a1253f760/users/b3da70a0bf52427baefed900ca926593/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:00.541797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.542117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.542388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.563275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:00.572717 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] MFA Rules not processed for user `b3da70a0bf52427baefed900ca926593`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:00.574561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:00.640347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1176/2358] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:00.674045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.675844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:00.734471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9e79-5023-414b-830e-dc05bff191c1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.738836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.739458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.739818 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.740091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.752863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.755183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c16a7-3f25-4339-81b2-443671fdc936 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.769323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1183/2359] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:00.784791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:00.850602 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951807c5-c5b8-4e0d-9e4b-d85f54db8d03 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:00.855606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:00.856291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.856575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.856846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] PATH_INFO: `/v3/users/b3da70a0bf52427baefed900ca926593` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.858017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3da70a0bf52427baefed900ca926593)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:00.860002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:00.909357 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3da70a0bf52427baefed900ca926593'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.909920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3da70a0bf52427baefed900ca926593'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.922199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3da70a0bf52427baefed900ca926593'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.922956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3da70a0bf52427baefed900ca926593'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.931753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3da70a0bf52427baefed900ca926593'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:00.944376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1177/2360] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:32:00 2022] DELETE /identity/v3/users/b3da70a0bf52427baefed900ca926593 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:00.948889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:00.949347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:00.949679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:00.969538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:00.971325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:01.042587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1184/2361] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:01.052553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.054007 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:01.076750 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:01.116732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552a83-21e5-48b0-bec5-c39105a8a293 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.121230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.121840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.122145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.122415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.132588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.134124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15062c8f-11f4-4835-8e86-badfbcab5d70 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.145292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1178/2362] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:01.435812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.437287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:01.460413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c1742-076a-448c-a275-ba9bc1220d24 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.465587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.466330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.466518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.466790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] PATH_INFO: `/v3/projects/484f17d385af4ac0ad393f1a1253f760` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.467908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] RBAC: Authorizing `identity:delete_project(project_id=484f17d385af4ac0ad393f1a1253f760)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.469832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.482134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:01.522776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484f17d385af4ac0ad393f1a1253f760', 'request_id': 'req-b5853edf-4b70-4f83-8fd1-466a1b5f374f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:01.528760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484f17d385af4ac0ad393f1a1253f760', 'request_id': 'req-b5853edf-4b70-4f83-8fd1-466a1b5f374f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:01.536428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484f17d385af4ac0ad393f1a1253f760', 'request_id': 'req-b5853edf-4b70-4f83-8fd1-466a1b5f374f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:01.549360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] The token cache is being invalidate because project 484f17d385af4ac0ad393f1a1253f760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:01.549670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:01.550334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-b5853edf-4b70-4f83-8fd1-466a1b5f374f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:01.551815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1185/2363] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:32:01 2022] DELETE /identity/v3/projects/484f17d385af4ac0ad393f1a1253f760 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:01.556692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.556979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.557311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.576075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:01.577264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:01.639066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1179/2364] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:01.646795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.647078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.647348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.666702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:01.667804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:01.676421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1186/2365] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:01.680748 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.690647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af178d-29f1-4c84-8db0-f734974e67b9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.695338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.695937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.696217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.696489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.697138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:32:01.697439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.699062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.714102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1180/2366] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:32:01.718137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.728474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad9fe3-034a-499e-bbbc-9e64ed243ac6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.739655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.740550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.740953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.741454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.743076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.745932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.784503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1187/2367] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:32:01 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:32:01.786000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.796880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d66dd-5301-4f04-90d1-0ec4148c097d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.873095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.873910 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.874228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.874502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.875141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.877788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.905000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1181/2368] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:32:01 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:01.906613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.919600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1733-5b07-4363-9bee-1011ea72fe83 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.930831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.931434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.931707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.931972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.932612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.934239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.944533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1188/2369] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:01.948629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.959276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c158db-c351-432f-b33f-266b45c6a312 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:01.964447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:01.965043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:01.965435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:01.965715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:01.966411 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:01.968028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0dc4f-639c-43d6-a530-597dad7047b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:01.982360 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1182/2370] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:01.983980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:01.995345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec1e5-fb7c-42f1-8965-547e0cc2f645 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:02.000598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:02.001318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:02.001648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:02.001921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] PATH_INFO: `/v3/projects/b13e20ca551d47779265dd5b8a8240c4/users/b1fc44d1978f40c59f3cfc221b734648/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:02.017971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13e20ca551d47779265dd5b8a8240c4, user_id=b1fc44d1978f40c59f3cfc221b734648, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:02.020702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:02.038536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1189/2371] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:32:01 2022] PUT /identity/v3/projects/b13e20ca551d47779265dd5b8a8240c4/users/b1fc44d1978f40c59f3cfc221b734648/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:32:02.051344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:02.051710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:02.052203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:02.084628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] MFA Rules not processed for user `b1fc44d1978f40c59f3cfc221b734648`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:02.085840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:02.105687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:02.177323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1183/2372] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:02.187246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:02.190250 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:02.263648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff96af-0c72-4643-9657-7065f911c6d7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:02.267890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:02.268866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:02.268866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:02.269098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:02.278689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:02.280317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:02.289840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1190/2373] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:02.935716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:02.937019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:03.018055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5e19b-6831-4f0d-bb44-9e4b4f147e80 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:03.023683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:03.024310 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:03.024658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:03.024997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:03.027001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:03.092433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:03.094144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759305fc-b1b6-4a90-8af5-4c94b11cd064 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:03.104591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1184/2374] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:03.451910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:03.461317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e22450-559e-4377-91f7-bee7a8e28be9 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:03.465004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:03.465598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:03.465866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:03.466166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:03.467868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:03.504951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:03.536874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:03.538527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:03.552047 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1191/2375] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:06.258778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:06.259316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:06.259417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:06.280260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] MFA Rules not processed for user `f8b0c96c80db4db4a477a1fa6c1fa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:06.282629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:06.288227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1185/2376] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:06.629524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:06.632310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:06.686392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec725b-b9b0-4939-b64f-659f25fdaf44 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:06.690566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:06.691158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:06.691427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:06.691690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:06.693354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:06.702336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:06.703745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:06.711461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1192/2377] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:07.046401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:07.047812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:07.141432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:07.166333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942954c8-74a2-430e-bd6d-db2cef784c41 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:07.172305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:07.172954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:07.174056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:07.174449 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:07.178006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:07.196123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:07.197709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd36bdb-e53f-468e-9c62-c1c1f8f7ce14 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:07.209464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1186/2378] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:11.007798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:11.021529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdcda5-f09f-4f4a-9d89-797184960ae2 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:11.027096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:11.027636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:11.027911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:11.028182 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:11.029993 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:11.087845 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:11.089425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:11.099024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1193/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:14.678128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:14.678618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:14.678618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:14.702082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] MFA Rules not processed for user `c11d183b3c0c4b2b83f3b52b881a72cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:14.703296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:14.711640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1187/2380] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:15.004512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:15.013740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899e5eb-7d5f-4590-b527-3b6f3e5bf5d9 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:15.017885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:15.018495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:15.018801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:15.019063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:15.020773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:15.030160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:15.031583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:15.039715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1194/2381] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:18.943254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:18.945200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:18.972090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f1207-70e9-4548-a825-22aef1b42a3a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:18.972090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:18.972340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:18.972837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:18.973140 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:18.975077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:18.985422 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:18.986901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879b5a9-31d0-4ed8-b088-4d0cdc5af426 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:18.995916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1188/2382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:20.261994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:20.331539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c6ca5-eee5-4c67-b830-8cf3d9ea32bd service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:20.337690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:20.338422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:20.338761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:20.339096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] PATH_INFO: `/v3/users/b1fc44d1978f40c59f3cfc221b734648` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:20.342125 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fc44d1978f40c59f3cfc221b734648)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:20.344081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:20.362755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:20.408473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fc44d1978f40c59f3cfc221b734648'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:20.409138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fc44d1978f40c59f3cfc221b734648'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:20.423652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fc44d1978f40c59f3cfc221b734648'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:20.433471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fc44d1978f40c59f3cfc221b734648'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:20.440915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fc44d1978f40c59f3cfc221b734648'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:20.446999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1195/2383] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:32:20 2022] DELETE /identity/v3/users/b1fc44d1978f40c59f3cfc221b734648 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:20.451619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:20.452075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:20.452201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:20.471177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:20.472917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:20.530848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1189/2384] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:20.542538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:20.544298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:20.607064 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4512b21-0855-4370-b78f-d4f5069b824a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:20.610743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:20.611347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:20.611618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:20.611885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:20.621382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:20.622880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c0d6c-1e04-424d-88ac-257dff5a6587 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:20.632499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1196/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:20.995686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:20.997733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:21.011434 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7005ea-ee8f-44ab-8c7b-2a51cc8fafae None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.019374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.021355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.021920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.023437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] PATH_INFO: `/v3/projects/b13e20ca551d47779265dd5b8a8240c4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.025648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13e20ca551d47779265dd5b8a8240c4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.030229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.096414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13e20ca551d47779265dd5b8a8240c4', 'request_id': 'req-21283315-737c-4cf8-9e8b-8be6958bb750'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:21.104238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13e20ca551d47779265dd5b8a8240c4', 'request_id': 'req-21283315-737c-4cf8-9e8b-8be6958bb750'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:21.114355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13e20ca551d47779265dd5b8a8240c4', 'request_id': 'req-21283315-737c-4cf8-9e8b-8be6958bb750'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:21.127993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] The token cache is being invalidate because project b13e20ca551d47779265dd5b8a8240c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:21.128496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:21.129761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-21283315-737c-4cf8-9e8b-8be6958bb750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:21.131490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1190/2386] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:32:20 2022] DELETE /identity/v3/projects/b13e20ca551d47779265dd5b8a8240c4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:21.136384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.136737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.137078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.158308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:21.159626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:21.226320 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1197/2387] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:21.235268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.235485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.235766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.256291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:21.257497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:21.265363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1191/2388] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:21.269607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.279897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a953f0-a0c6-478b-8bf0-859992df79e5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.284519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.285173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.285454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.285719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.286410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:32:21.286712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.288319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.301721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1198/2389] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:32:21.305010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.314377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c233dd-2a9f-419c-8ed3-14a569739d51 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.319719 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.320312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.320592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.320865 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.321495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.323438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.355253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1192/2390] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:32:21 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:21.356636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.374513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b296d5-3302-4fda-8bb4-035bc5c235c5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.387475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:21.495839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.498703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.500158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.500603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.501790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.504231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.543193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.544268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1199/2391] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:32:21 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:21.557769 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b79db-7426-43d8-b409-d76cf8ed58e7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.567505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.568668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.569112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.569534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.571665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.574014 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.593103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1193/2392] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:21.594304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.606646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849550e-7c2e-4c28-a7c3-cff83671e224 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.611528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.612414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.612618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.613010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.613864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.615887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e91e48-73b4-4e85-9d30-e7a6f9e78025 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.632456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1200/2393] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:32:21.632678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.637771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:21.645933 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e67121-cda6-4608-bc95-475fe93a0d86 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.651500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.652440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.652951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.653529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] PATH_INFO: `/v3/projects/fecc5bbb9bd84c58af2302dcde767691/users/3b8a70d6cf4a46ea9b4de37a34ce97d6/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.672063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecc5bbb9bd84c58af2302dcde767691, user_id=3b8a70d6cf4a46ea9b4de37a34ce97d6, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.675159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.708664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1194/2394] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:32:21 2022] PUT /identity/v3/projects/fecc5bbb9bd84c58af2302dcde767691/users/3b8a70d6cf4a46ea9b4de37a34ce97d6/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:21.718499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247902c-3982-44fb-b85c-a84fc74404df None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.718762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247902c-3982-44fb-b85c-a84fc74404df None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.719101 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247902c-3982-44fb-b85c-a84fc74404df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.748819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d247902c-3982-44fb-b85c-a84fc74404df None None] MFA Rules not processed for user `3b8a70d6cf4a46ea9b4de37a34ce97d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:21.749950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d247902c-3982-44fb-b85c-a84fc74404df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:21.818189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1201/2395] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:21.829366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:21.831295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:21.916903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28497f69-2e6e-46ae-9b5c-12d9e2ee5e2a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:21.921902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:21.922737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:21.923060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:21.923332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:21.934012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:21.935510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:21.946621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1195/2396] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:23.429409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:23.429950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:23.429950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:23.453878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] MFA Rules not processed for user `3b8a70d6cf4a46ea9b4de37a34ce97d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:23.455160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:23.462154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1202/2397] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:26.898326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:26.899908 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:27.021158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c480-6f66-45f5-8b15-89ed47c4d6ff service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:27.031758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:27.032603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:27.032951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:27.033293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:27.036649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:27.055409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:27.057502 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc8d02-5764-49b3-adc2-e6ba1ec05992 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:27.074669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1196/2398] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:28.787523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:28.790918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:28.824529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde28133-0d96-4ec7-887e-1d53e2252932 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:28.840549 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:28.841868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:28.842173 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:28.842446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:28.844540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:28.861479 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:28.864476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:28.877116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1203/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:31.549783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:31.550304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:31.550501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:31.569600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:31.570874 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:31.627739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1197/2400] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:31.675663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:31.677113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:31.747426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:31.754776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4962703-3230-4563-ba97-1cb751423d44 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:31.762280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:31.762866 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:31.763139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:31.763404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:31.778550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:31.780109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ceb6c-bc66-482a-8058-24a2fb80af17 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:31.789383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1204/2401] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:36.492391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:36.511490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db627d-9ca4-44cc-a109-af84c0bb30db None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:36.523936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:36.524572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:36.524862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:36.525405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:36.528702 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:36.546738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:36.549174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:36.555587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:36.564735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1198/2402] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:37.201864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:37.202427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:37.202520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:37.223644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:37.224864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:37.233108 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1205/2403] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:37.257992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:37.276113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf2d2-21cb-4e4d-b339-999098479c8f service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:37.290800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:37.291410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:37.291684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:37.291949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:37.306193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:37.308402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:37.347274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1199/2404] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:42.259163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:42.262325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:42.372355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d694d97-e47f-41b1-bc5d-1246d936129e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:42.377599 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:42.378340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:42.378685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:42.379019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:42.380884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:42.392656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:42.394935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:42.405332 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1206/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:45.737191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:45.739271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:45.806402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcac0-5e6c-43ba-9a34-262a3b2fe190 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:45.810937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:45.811562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:45.811835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:45.812102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] PATH_INFO: `/v3/users/2aa5f23fe0ea4030b3858f3e5ccde8c1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:45.813223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa5f23fe0ea4030b3858f3e5ccde8c1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:45.815153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:45.865446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa5f23fe0ea4030b3858f3e5ccde8c1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:45.866046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa5f23fe0ea4030b3858f3e5ccde8c1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:45.879485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa5f23fe0ea4030b3858f3e5ccde8c1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:45.880003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa5f23fe0ea4030b3858f3e5ccde8c1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:45.890032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa5f23fe0ea4030b3858f3e5ccde8c1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:45.906692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1200/2406] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:32:45 2022] DELETE /identity/v3/users/2aa5f23fe0ea4030b3858f3e5ccde8c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:46.105444 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:46.120094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afbc33-011d-4916-a72b-43050edf4b20 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:46.179075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:46.179703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:46.179981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:46.180251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] PATH_INFO: `/v3/projects/5192a78d86bc40ae96a3cbb283992463` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:46.181419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5192a78d86bc40ae96a3cbb283992463)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:46.183356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:46.228392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5192a78d86bc40ae96a3cbb283992463', 'request_id': 'req-cede0fab-e75f-4afd-9bb0-b2b8179c1797'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.233870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5192a78d86bc40ae96a3cbb283992463', 'request_id': 'req-cede0fab-e75f-4afd-9bb0-b2b8179c1797'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.241640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5192a78d86bc40ae96a3cbb283992463', 'request_id': 'req-cede0fab-e75f-4afd-9bb0-b2b8179c1797'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.253426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] The token cache is being invalidate because project 5192a78d86bc40ae96a3cbb283992463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:46.253706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.254484 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.255979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1207/2407] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:32:46 2022] DELETE /identity/v3/projects/5192a78d86bc40ae96a3cbb283992463 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:46.260137 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:46.261515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:46.274886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7c757-c9cf-4152-a2b6-c9bb6dd6a0c0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:46.333374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:46.334062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:46.334342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:46.334610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] PATH_INFO: `/v3/users/616a531e57114b16bc9eaf2d8216c664` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:46.335709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616a531e57114b16bc9eaf2d8216c664)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:46.337725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:46.346148 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:46.408157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616a531e57114b16bc9eaf2d8216c664'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.408890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616a531e57114b16bc9eaf2d8216c664'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.424043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616a531e57114b16bc9eaf2d8216c664'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.425477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616a531e57114b16bc9eaf2d8216c664'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.433330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0cbd15f3-0e7a-4a56-bbf4-789f3429be06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616a531e57114b16bc9eaf2d8216c664'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.453265 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1201/2408] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:32:46 2022] DELETE /identity/v3/users/616a531e57114b16bc9eaf2d8216c664 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:46.687002 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:46.688551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:46.699355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:46.703640 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede0fab-e75f-4afd-9bb0-b2b8179c1797 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:46.774983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:46.775613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:46.775889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:46.776160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] PATH_INFO: `/v3/projects/bce6922c8d2d48acb9630463d132ef3c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:46.777328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce6922c8d2d48acb9630463d132ef3c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:46.779269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:46.825926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce6922c8d2d48acb9630463d132ef3c', 'request_id': 'req-dc984796-aa0c-4037-ba19-f997a871f523'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.832166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce6922c8d2d48acb9630463d132ef3c', 'request_id': 'req-dc984796-aa0c-4037-ba19-f997a871f523'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.840022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce6922c8d2d48acb9630463d132ef3c', 'request_id': 'req-dc984796-aa0c-4037-ba19-f997a871f523'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.852285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] The token cache is being invalidate because project bce6922c8d2d48acb9630463d132ef3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:46.852593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.853448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:46.855040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1208/2409] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:32:46 2022] DELETE /identity/v3/projects/bce6922c8d2d48acb9630463d132ef3c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:47.114282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e1c8-201f-4e64-b8d1-d3ec969fc40f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:47.114713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e1c8-201f-4e64-b8d1-d3ec969fc40f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:47.115012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e1c8-201f-4e64-b8d1-d3ec969fc40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:47.134679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2013e1c8-201f-4e64-b8d1-d3ec969fc40f None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:47.135882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2013e1c8-201f-4e64-b8d1-d3ec969fc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:47.194386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1202/2410] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:47.206113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:47.216998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:47.279323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc984796-aa0c-4037-ba19-f997a871f523 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:47.284924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:47.285546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:47.285865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:47.286132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:47.294428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:47.296043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:47.304683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1209/2411] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:47.847599 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35b1-acce-4788-b5e6-5d2155fe13f8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:47.847884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35b1-acce-4788-b5e6-5d2155fe13f8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:47.848157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e35b1-acce-4788-b5e6-5d2155fe13f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:47.868026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-158e35b1-acce-4788-b5e6-5d2155fe13f8 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:47.869258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-158e35b1-acce-4788-b5e6-5d2155fe13f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:47.876563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1203/2412] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:47.890234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:47.900541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc0c-4937-479c-b732-6b01bd4de8e4 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:47.905838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:47.906504 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:47.906804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:47.907076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:47.915814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:47.917383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:47.926339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1210/2413] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:48.150655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab05cf-195a-4db1-96cf-0d549d687a89 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:48.151141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab05cf-195a-4db1-96cf-0d549d687a89 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:48.151240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab05cf-195a-4db1-96cf-0d549d687a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:48.170355 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-54ab05cf-195a-4db1-96cf-0d549d687a89 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:48.171556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-54ab05cf-195a-4db1-96cf-0d549d687a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:48.178779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1204/2414] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:48.192119 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:48.203316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c8f6b-0259-4cac-936b-de3c4a545720 service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:48.208906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:48.209509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:48.209689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:48.209954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:48.218376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:48.219951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:48.223531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:48.234496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1211/2415] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:48.557652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa2ab-eb93-40da-8f2a-cb7ff3eaf5ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:48.557936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa2ab-eb93-40da-8f2a-cb7ff3eaf5ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:48.558235 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa2ab-eb93-40da-8f2a-cb7ff3eaf5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:48.577267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-27daa2ab-eb93-40da-8f2a-cb7ff3eaf5ce None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:48.578472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-27daa2ab-eb93-40da-8f2a-cb7ff3eaf5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:48.585567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1205/2416] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:48.597386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:48.607796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa1e0-ac97-445f-9c59-ff03bccc7ecd service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:48.613234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:48.613815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:48.614123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:48.614398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:48.622441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:48.624005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:48.632523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1212/2417] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:49.455176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:49.455648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:49.455747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:49.477571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:49.482747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:49.488529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1206/2418] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:49.500340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:49.513291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522376-0e05-4132-ad2f-f509a44ca87c service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:49.522441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:49.523046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:49.523319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:49.523586 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:49.532481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:49.535183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c61d4-acc5-4ecd-a002-a6e6f2367955 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:49.542875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1213/2419] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:32:50.791778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:50.793201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:50.862275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae2a1-379d-4d72-8217-563127bf30ca None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:50.867372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:50.868021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:50.868302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:50.868574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] PATH_INFO: `/v3/users/3b8a70d6cf4a46ea9b4de37a34ce97d6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:50.869725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8a70d6cf4a46ea9b4de37a34ce97d6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:50.871701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:50.874510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:50.936666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8a70d6cf4a46ea9b4de37a34ce97d6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:50.937633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8a70d6cf4a46ea9b4de37a34ce97d6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:50.950897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8a70d6cf4a46ea9b4de37a34ce97d6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:50.951729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8a70d6cf4a46ea9b4de37a34ce97d6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:50.962682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8a70d6cf4a46ea9b4de37a34ce97d6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:50.975841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1207/2420] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:32:50 2022] DELETE /identity/v3/users/3b8a70d6cf4a46ea9b4de37a34ce97d6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:50.980561 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:50.981046 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:50.981144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.001393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:51.002655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:51.075262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1214/2421] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:51.085785 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.087276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:51.157592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed23bf-b23c-4536-a464-1a18745baadd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.162338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.162962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.163349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.163657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.173399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.174845 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0d396-6756-4ced-9b5b-19eb1ba4ef8c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.184445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1208/2422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:32:51.394353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.395904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:51.415252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7d625-784d-476d-87fc-ed77373929c1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.432686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.433349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.433625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.433893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] PATH_INFO: `/v3/projects/fecc5bbb9bd84c58af2302dcde767691` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.435080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecc5bbb9bd84c58af2302dcde767691)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.437043 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.509652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecc5bbb9bd84c58af2302dcde767691', 'request_id': 'req-3f5e00c7-2775-42d7-b481-9ac45e447f86'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:51.515746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecc5bbb9bd84c58af2302dcde767691', 'request_id': 'req-3f5e00c7-2775-42d7-b481-9ac45e447f86'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:51.524517 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecc5bbb9bd84c58af2302dcde767691', 'request_id': 'req-3f5e00c7-2775-42d7-b481-9ac45e447f86'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:51.536783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] The token cache is being invalidate because project fecc5bbb9bd84c58af2302dcde767691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:32:51.537100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:51.537731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3f5e00c7-2775-42d7-b481-9ac45e447f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:32:51.539256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1215/2423] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:32:51 2022] DELETE /identity/v3/projects/fecc5bbb9bd84c58af2302dcde767691 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:51.544325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.544609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.544882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.569303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:51.570841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:51.640560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1209/2424] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:32:51.647683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.647963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.648230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.667607 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:51.668819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:51.676916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1216/2425] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:51.681144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.692059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95a17d-63db-4fa5-b6bb-258c12a5a391 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.697564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.698219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.698494 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.698761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.699424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:32:51.699723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.701328 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.714404 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1210/2426] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:32:51.718990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.728692 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09fad-abdf-4d79-bf5b-f5ededb64a4c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.733813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.734521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.737158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.737158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.737158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.738414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.769261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1217/2427] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:32:51 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:51.773813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.784297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541bd84-6708-4292-b8d4-58d6cb08b80f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.792834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:51.846798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.847629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.848039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.848375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.849074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.851426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.874742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1211/2428] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:32:51 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:32:51.878910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.890282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4a5f7-0755-429c-87f3-d67ae1410545 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.895813 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.896523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.896807 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.897145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.897786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.899432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.909884 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1218/2429] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:32:51.913851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.925049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15052-ba9e-496a-9163-e25d77ed481b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.929930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.930578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.930861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.931133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.931776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.933428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54318d8-ecfb-4b27-b9ee-b408ca26311b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:51.945279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1212/2430] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:32:51.949495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:51.960772 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9a8c-f7f2-442c-af13-e22c9edd1c53 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:51.965712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:51.966424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:51.966688 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:51.966966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] PATH_INFO: `/v3/projects/0c11e86389144a8f9a2e623838ae44a6/users/af5f26e1ce924ad0892da8ba69785331/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:51.982291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:32:51.986148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c11e86389144a8f9a2e623838ae44a6, user_id=af5f26e1ce924ad0892da8ba69785331, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:51.990476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:52.011197 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1219/2431] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:32:51 2022] PUT /identity/v3/projects/0c11e86389144a8f9a2e623838ae44a6/users/af5f26e1ce924ad0892da8ba69785331/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:32:52.022835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c6cf-7179-4824-92f4-abb101ab2a5c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:52.023386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c6cf-7179-4824-92f4-abb101ab2a5c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:52.023824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69c6cf-7179-4824-92f4-abb101ab2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:52.058791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ea69c6cf-7179-4824-92f4-abb101ab2a5c None None] MFA Rules not processed for user `af5f26e1ce924ad0892da8ba69785331`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:32:52.060188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ea69c6cf-7179-4824-92f4-abb101ab2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:52.132171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1213/2432] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:32:52.145123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:32:52.147255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:32:52.217625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd41bde-507e-4946-8fa5-5a00c9f4b04e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:32:52.221351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:32:52.221939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:32:52.222242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:32:52.222506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:32:52.232193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:32:52.234216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:32:52.248799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1220/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:02.128249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:02.241174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:10.539361 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:10.539794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:10.539916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:10.559157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:10.560348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:10.613816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1214/2434] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:10.626145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:10.627527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:10.694851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b2f4-653c-4920-9c22-7c7004913569 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:10.699695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:10.700282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:10.700562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:10.700828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:10.709131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:10.710731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de1db-e983-410d-96bc-11984facbc19 service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:10.718583 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1221/2435] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:33:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:33:11.928660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:11.989852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d82f93-3dca-4ba0-988e-67f3523c3d12 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:11.994527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:11.995129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:11.995401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:11.995666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] PATH_INFO: `/v3/users/af5f26e1ce924ad0892da8ba69785331` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:11.996764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5f26e1ce924ad0892da8ba69785331)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:11.998713 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:12.043375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5f26e1ce924ad0892da8ba69785331'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.044035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5f26e1ce924ad0892da8ba69785331'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.055567 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5f26e1ce924ad0892da8ba69785331'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.056187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5f26e1ce924ad0892da8ba69785331'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.063181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5f26e1ce924ad0892da8ba69785331'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.075634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1215/2436] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:33:11 2022] DELETE /identity/v3/users/af5f26e1ce924ad0892da8ba69785331 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:12.080075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:12.080555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:12.080656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:12.099869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:12.101074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:12.159063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1222/2437] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:12.168651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:12.170091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:12.197797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:12.228596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cd55c-65ca-4843-8478-ac0a5db14ac3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:12.232350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:12.232965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:12.233237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:12.233501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:12.243036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:12.244439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:12.254253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1216/2438] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:33:12.515098 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:12.516510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:12.528238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64ff0-c466-4ff9-851b-27a6e7290dab None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:12.532741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:12.533360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:12.533631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:12.533895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] PATH_INFO: `/v3/projects/0c11e86389144a8f9a2e623838ae44a6` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:12.535196 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c11e86389144a8f9a2e623838ae44a6)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:12.537073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:12.583206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c11e86389144a8f9a2e623838ae44a6', 'request_id': 'req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.588631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c11e86389144a8f9a2e623838ae44a6', 'request_id': 'req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.595934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c11e86389144a8f9a2e623838ae44a6', 'request_id': 'req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.607565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] The token cache is being invalidate because project 0c11e86389144a8f9a2e623838ae44a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:33:12.607971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.608601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:12.610148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1223/2439] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:33:12 2022] DELETE /identity/v3/projects/0c11e86389144a8f9a2e623838ae44a6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:22.249552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=15 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:22.604477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:40.288431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:40.289914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:40.306190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d604ed2-211c-4d49-bafc-4af97d4dfa8c service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:40.356990 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:40.357589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:40.357855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:40.358152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:40.359839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:40.428996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:40.430486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:40.441424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1217/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:43.437448 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:43.439873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:43.456812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3dd35-dec0-4c01-953b-fb1126c29ae8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:43.461938 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:43.462592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:43.462868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:43.463133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] PATH_INFO: `/v3/users/f8b0c96c80db4db4a477a1fa6c1fa4db` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:43.464251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b0c96c80db4db4a477a1fa6c1fa4db)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:43.466195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:43.516892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b0c96c80db4db4a477a1fa6c1fa4db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.517658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b0c96c80db4db4a477a1fa6c1fa4db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.530286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b0c96c80db4db4a477a1fa6c1fa4db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.538343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b0c96c80db4db4a477a1fa6c1fa4db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.551541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e66735a1-6103-4344-aa4a-0441dd417b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b0c96c80db4db4a477a1fa6c1fa4db'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.557380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1224/2441] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:33:43 2022] DELETE /identity/v3/users/f8b0c96c80db4db4a477a1fa6c1fa4db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:43.729340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:43.741644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7411bbe-2103-433d-8752-977a47bb81e4 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:43.803587 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:43.804144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:43.804421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:43.804689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] PATH_INFO: `/v3/projects/99d9a3fa9369495ab6d8da88f3d9dbd5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:43.805780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d9a3fa9369495ab6d8da88f3d9dbd5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:43.807700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:43.854211 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'request_id': 'req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.856127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:43.860968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'request_id': 'req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.869415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d9a3fa9369495ab6d8da88f3d9dbd5', 'request_id': 'req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.880648 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] The token cache is being invalidate because project 99d9a3fa9369495ab6d8da88f3d9dbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:33:43.880930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.881565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f4137fbc-8fc7-44d6-bdca-dd3f80cf9ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:43.883386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1218/2442] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:33:43 2022] DELETE /identity/v3/projects/99d9a3fa9369495ab6d8da88f3d9dbd5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:43.888968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:43.889253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:43.889519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:43.911413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:43.912616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:43.975171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1225/2443] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:43.983822 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:43.984103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:43.984379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.003798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:44.005010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:44.012743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1219/2444] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:44.017018 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.027281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33072d38-f391-47e3-a8ce-b275d2712432 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.031890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.032489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.032767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.033045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.034312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:33:44.034609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.036214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.047646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1226/2445] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:33:44.051921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.061086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21539c5a-42c0-4382-b247-2720cc08a3f2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.065677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.066299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.066576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.066846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.067469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.069348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.098103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1220/2446] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:33:44.102126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.112035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef11a4-a1c7-429e-a231-acae3f1a50eb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.166789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.167381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.167662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.167928 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.168538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.170501 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.178157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:44.192616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1227/2447] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:33:44.196694 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.207802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007564e-848d-444b-94ff-7b81ff8dda9d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.212623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.213223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.213503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.213776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.214456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.216049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.226262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1221/2448] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:33:44.230321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.240260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ee9d-bae0-46f1-8d54-3219f4bb21bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.245078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.245663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.245940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.246244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.246882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.248467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dd99-ae8b-469f-999b-c0f38755e3c0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.259279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1228/2449] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:44.263130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.273577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf3f4c-0bdc-43dc-911b-ba0dde72987f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.278203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.278840 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.279119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.279393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] PATH_INFO: `/v3/projects/a5565c38f1cc472e8adbd05a1383a57f/users/430ff187abb54d6194892e995c87b098/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.294220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5565c38f1cc472e8adbd05a1383a57f, user_id=430ff187abb54d6194892e995c87b098, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.296869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.309922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1222/2450] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:44 2022] PUT /identity/v3/projects/a5565c38f1cc472e8adbd05a1383a57f/users/430ff187abb54d6194892e995c87b098/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:33:44.320502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.320785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.321049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.352315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] MFA Rules not processed for user `430ff187abb54d6194892e995c87b098`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:44.353526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:44.418601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1229/2451] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:44.423047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.490299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e400-fab0-4682-b226-625c1b24c6e4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.495499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.496110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.496393 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.496666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.497298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.499230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.534427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1223/2452] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/projects => generated 361 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:33:44.536035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.555144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4972c4-ffff-44b6-8619-04c44b71556e None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.622554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.623170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.623450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.623721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.624343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.626310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.649393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1230/2453] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:33:44.653228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.665498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5e38-8b6f-4fbd-aae9-d9e61d9e19b8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.668127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.668700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.668982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.669252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.669891 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.671548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.682935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1224/2454] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:44.687056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.698019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7064178-703b-4b41-b39e-2c43d75369b8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.702840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.703521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.703799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.704069 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] PATH_INFO: `/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73/users/aad2d479f3a94908ab8c53e7fe32c467/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.719423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cb5acd4aa1430aad439f36b3adcc73, user_id=aad2d479f3a94908ab8c53e7fe32c467, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.722329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.735656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1231/2455] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:44 2022] PUT /identity/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73/users/aad2d479f3a94908ab8c53e7fe32c467/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:44.740205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.750471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793f1b2-377e-4f39-93c1-db4f39c87b39 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.817394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:44.828506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.829155 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.829634 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.829988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.831030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.832950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2a8e-9de4-42d8-86ed-ae7a5db30700 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.843113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1225/2456] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:44.847943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:44.858474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc009ae8-7b50-4a35-8503-d00747006c24 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:44.863766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:44.864490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.864836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.865175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] PATH_INFO: `/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73/users/aad2d479f3a94908ab8c53e7fe32c467/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.867358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cb5acd4aa1430aad439f36b3adcc73, user_id=aad2d479f3a94908ab8c53e7fe32c467, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:44.870022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:44.881290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1232/2457] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:44 2022] PUT /identity/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73/users/aad2d479f3a94908ab8c53e7fe32c467/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:44.892818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:44.893104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:44.893478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:44.921141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] MFA Rules not processed for user `aad2d479f3a94908ab8c53e7fe32c467`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:44.922389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:44.991906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1226/2458] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:45.003351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:45.005297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:45.029081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:45.065136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdc20c-f5db-434c-a8e9-7512b742d299 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:45.068782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:45.069384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:45.069660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:45.069930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:45.078743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:45.080193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf15054-15e8-4f4a-9471-f88d2baee81d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:45.089477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1233/2459] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:45.497061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:45.557883 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef845752-05ca-470d-8cde-58fa4821a32a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:45.562286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:45.562896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:45.563171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:45.563439 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] PATH_INFO: `/v3/users/430ff187abb54d6194892e995c87b098` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:45.564532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=430ff187abb54d6194892e995c87b098)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:45.566467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:45.612273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430ff187abb54d6194892e995c87b098'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:45.612906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430ff187abb54d6194892e995c87b098'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:45.625138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430ff187abb54d6194892e995c87b098'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:45.625777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430ff187abb54d6194892e995c87b098'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:45.633477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430ff187abb54d6194892e995c87b098'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:45.635470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:45.648145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1227/2460] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:33:45 2022] DELETE /identity/v3/users/430ff187abb54d6194892e995c87b098 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:45.652657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:45.653133 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:45.653257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:45.671602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:45.672782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:45.729163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1234/2461] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:45.738804 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:45.740160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:45.796185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c251f-be85-48dc-816d-a3d143453fd0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:45.799913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:45.800515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:45.800795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:45.801067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:45.810086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:45.811509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:45.821304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1228/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:46.389639 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:46.391324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:46.403789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92810-577e-42a8-b7ba-4ec3059a2f7c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:46.409212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:46.409851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:46.410165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:46.410436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] PATH_INFO: `/v3/projects/a5565c38f1cc472e8adbd05a1383a57f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:46.411751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5565c38f1cc472e8adbd05a1383a57f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:46.413539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:46.464341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5565c38f1cc472e8adbd05a1383a57f', 'request_id': 'req-1443dbe3-d202-40ab-8496-889631907cc9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.470034 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5565c38f1cc472e8adbd05a1383a57f', 'request_id': 'req-1443dbe3-d202-40ab-8496-889631907cc9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.478215 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5565c38f1cc472e8adbd05a1383a57f', 'request_id': 'req-1443dbe3-d202-40ab-8496-889631907cc9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.491168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] The token cache is being invalidate because project a5565c38f1cc472e8adbd05a1383a57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:33:46.491460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.492400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.494349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1235/2463] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:33:46 2022] DELETE /identity/v3/projects/a5565c38f1cc472e8adbd05a1383a57f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:46.498039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:46.509677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b19d3-af1f-40ea-ad8d-9e2c4c9d88bc service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:46.565540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:46.566195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:46.566477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:46.566751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] PATH_INFO: `/v3/users/aad2d479f3a94908ab8c53e7fe32c467` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:46.567858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad2d479f3a94908ab8c53e7fe32c467)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:46.569773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:46.614149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad2d479f3a94908ab8c53e7fe32c467'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.614727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad2d479f3a94908ab8c53e7fe32c467'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.626744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad2d479f3a94908ab8c53e7fe32c467'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.627868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad2d479f3a94908ab8c53e7fe32c467'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.635491 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1252aa16-abf8-4ce9-9f97-f849f20ddc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad2d479f3a94908ab8c53e7fe32c467'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:46.648209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1229/2464] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:33:46 2022] DELETE /identity/v3/users/aad2d479f3a94908ab8c53e7fe32c467 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:46.925941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:46.927689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:46.947898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443dbe3-d202-40ab-8496-889631907cc9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:46.993545 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:47.009160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.009785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.010092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.010409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] PATH_INFO: `/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.011469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cb5acd4aa1430aad439f36b3adcc73)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.013351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.058799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cb5acd4aa1430aad439f36b3adcc73', 'request_id': 'req-bff58d4e-2ace-4981-99ea-5f7f700e6768'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:47.064153 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cb5acd4aa1430aad439f36b3adcc73', 'request_id': 'req-bff58d4e-2ace-4981-99ea-5f7f700e6768'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:47.071624 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cb5acd4aa1430aad439f36b3adcc73', 'request_id': 'req-bff58d4e-2ace-4981-99ea-5f7f700e6768'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:47.083948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] The token cache is being invalidate because project c0cb5acd4aa1430aad439f36b3adcc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:33:47.084434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:47.085085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bff58d4e-2ace-4981-99ea-5f7f700e6768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:33:47.086675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1236/2465] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:33:46 2022] DELETE /identity/v3/projects/c0cb5acd4aa1430aad439f36b3adcc73 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:47.092244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.092744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.092855 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.114850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:47.116063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:47.127665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:47.185471 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1230/2466] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:47.194263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.194608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.194885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.223328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:47.224822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:47.234646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1237/2467] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:47.239068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.249520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c3414-6452-475a-a7e1-ea502a852ff0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.254983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.255600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.255907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.256180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.256831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:33:47.257130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.258782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.274246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1231/2468] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:33:47.276454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.287088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66526c-9de6-4305-b25e-fcff66e50be2 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.292265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.293481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.293927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.294415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.295214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.297323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.332180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1238/2469] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:33:47.333402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.345606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d249faf-d1ed-4015-9a2e-a96bdd14b9f8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.411091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.411672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.411954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.412253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.413167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.415181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.443523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1232/2470] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:33:47.447602 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.459360 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517853f-f54a-4caf-9cbd-b7c54d450e9c admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.465169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.465785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.466107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.466379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.467229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.468820 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.482073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1239/2471] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:33:47.484165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.496603 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab028940-91b4-40db-9e9b-c404eb20d2b3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.504063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.504774 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.505115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.505458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.506195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.507892 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b38fb-b838-464c-950d-0e357f3ebdf3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.523508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1233/2472] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:47.527616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.546009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43aa26-fc13-43b7-a557-f219c7d70505 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.551755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.552514 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.552897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.553238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] PATH_INFO: `/v3/projects/1c50e742db254ac0ac140fe991d6b2d6/users/e55f8134be4a44bba1cc238eaf4e8093/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.569746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c50e742db254ac0ac140fe991d6b2d6, user_id=e55f8134be4a44bba1cc238eaf4e8093, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.572633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.597877 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1240/2473] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:47 2022] PUT /identity/v3/projects/1c50e742db254ac0ac140fe991d6b2d6/users/e55f8134be4a44bba1cc238eaf4e8093/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:33:47.600047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.600333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.600610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.635145 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] MFA Rules not processed for user `e55f8134be4a44bba1cc238eaf4e8093`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:47.636539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:47.711718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1234/2474] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:47.712994 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.808519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a7b5d-3f7e-4732-b7f6-ca5faa3d4ae0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.813923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.815136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.815494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.815903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.816553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.818544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.842348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:47.857339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.862028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1241/2475] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:33:47.869546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2891-fdd0-4980-a8a9-712c0b8c7473 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.876194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:47.933315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.934178 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.934510 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.935037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.935727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.937795 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.961057 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1235/2476] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:33:47 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:33:47.966257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:47.977721 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bddc2-2153-4106-85b5-820e3fe42ae7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:47.982330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:47.982936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:47.983199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:47.983468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:47.984104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:47.985690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:47.996787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1242/2477] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:48.001003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:48.011454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f868f-c88f-451e-9f3d-cfa1b9212762 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:48.016027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:48.016664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:48.016938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:48.017206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] PATH_INFO: `/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd/users/5639e716995744178483aaf47f11739a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:48.032953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2761ea16cf46f8a69a0b7c8443afcd, user_id=5639e716995744178483aaf47f11739a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:48.035692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:48.049344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1236/2478] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:48 2022] PUT /identity/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd/users/5639e716995744178483aaf47f11739a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:48.053367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:48.063588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baedce-f928-4de5-b61c-fb44e86eb903 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:48.122420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:48.123039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:48.123327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:48.123637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:48.124227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:48.125822 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc14200-ebb9-43db-84a3-16e60de28753 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:48.140496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1243/2479] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:33:48.144848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:48.157608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb1788-a79c-4987-9db5-9e772632da1c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:48.163379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:48.164039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:48.164335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:48.164593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] PATH_INFO: `/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd/users/5639e716995744178483aaf47f11739a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:48.166571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2761ea16cf46f8a69a0b7c8443afcd, user_id=5639e716995744178483aaf47f11739a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:48.169230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:48.192732 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1237/2480] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:33:48 2022] PUT /identity/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd/users/5639e716995744178483aaf47f11739a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:33:48.195468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:48.195833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:48.196982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:48.229670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] MFA Rules not processed for user `5639e716995744178483aaf47f11739a`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:33:48.230921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:48.308730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1244/2481] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:33:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:33:48.320237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:48.322064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:48.383207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64511aa-7442-4598-8658-3c071b6035ef admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:48.386911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:48.387513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:48.387791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:48.388061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:48.447099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:48.448451 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:48.457896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1238/2482] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:53.148060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:53.158074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8353-0087-4b7b-b2c3-18fd9667d379 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:53.161619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:53.162246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:53.162524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:53.162795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:53.171737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:53.173146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:53.182906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1245/2483] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:33:57.047053 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:33:57.048432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:57.067446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:33:57.111572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffe8fe-1acb-4782-be03-6bf958f5cbff service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:33:57.116736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:33:57.117677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:33:57.118082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:33:57.118430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:33:57.120215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:33:57.185445 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:33:57.186913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:33:57.197875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1239/2484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:00.400207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:00.401660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:00.416379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2dce2-ce6b-423a-9df4-74408a7df73d service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:00.421021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:00.421617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:00.421890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:00.422193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] PATH_INFO: `/v3/users/c11d183b3c0c4b2b83f3b52b881a72cf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:00.423278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11d183b3c0c4b2b83f3b52b881a72cf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:00.425235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:00.469838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11d183b3c0c4b2b83f3b52b881a72cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.470553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11d183b3c0c4b2b83f3b52b881a72cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.473116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:00.484785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11d183b3c0c4b2b83f3b52b881a72cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.492796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11d183b3c0c4b2b83f3b52b881a72cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.500315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-df4cd70e-a5db-4739-91b5-73cb0275aeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11d183b3c0c4b2b83f3b52b881a72cf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.506577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1246/2485] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:00 2022] DELETE /identity/v3/users/c11d183b3c0c4b2b83f3b52b881a72cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:00.685334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:00.696266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aef699-6124-42ff-a519-71f9a2696d76 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:00.754744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:00.755535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:00.755818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:00.756118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] PATH_INFO: `/v3/projects/3c491181ae054706be3bdc94c61501f9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:00.757247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c491181ae054706be3bdc94c61501f9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:00.759219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:00.804513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c491181ae054706be3bdc94c61501f9', 'request_id': 'req-638a7b30-1297-427e-ba9e-a995c58c4bc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.809970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c491181ae054706be3bdc94c61501f9', 'request_id': 'req-638a7b30-1297-427e-ba9e-a995c58c4bc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.817524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c491181ae054706be3bdc94c61501f9', 'request_id': 'req-638a7b30-1297-427e-ba9e-a995c58c4bc1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.819741 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:00.831003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] The token cache is being invalidate because project 3c491181ae054706be3bdc94c61501f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:00.832083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.832722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-638a7b30-1297-427e-ba9e-a995c58c4bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:00.834246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1240/2486] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:00 2022] DELETE /identity/v3/projects/3c491181ae054706be3bdc94c61501f9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:00.839107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:00.839399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:00.839672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:00.859978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:00.861208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:00.921536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1247/2487] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:00.930170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:00.930460 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:00.930739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:00.950766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:00.951997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:00.959909 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1241/2488] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:00.964027 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:00.973631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfff3cb-7390-4eb2-8a33-2c39f8e51c2a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:00.978237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:00.978826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:00.979100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:00.979374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:00.980011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:00.980307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:00.981889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:00.994083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1248/2489] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:00.998470 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.008698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d31b0-9a0e-46b6-86bb-0bc074b90895 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.013324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.013916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.014231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.014504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.015120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.017014 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.045509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1242/2490] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:00 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:01.050414 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.060261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2dfc5-ab8a-43c2-8b96-7e33a72bfc0e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.115256 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.115790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.116116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.116388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.117289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.119246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.140872 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1249/2491] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:01 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:01.145306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.155972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8028d7-8228-4091-be4c-fe890d387339 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.162895 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.163513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.163809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.164097 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.164738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.166365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.177922 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1243/2492] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:01.183275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.197565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062210e7-0fd0-4ba8-bf40-500aa080e508 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.204160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.204840 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.205171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.205447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.206213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.207885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.225659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.226100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1250/2493] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:01.236850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bca37f-3326-4866-8ebd-b027e1374cea admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.241809 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.242754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.243032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.243303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] PATH_INFO: `/v3/projects/13126ef6565748bcb057578ea117d34f/users/8d67f2fcf09e4c3485b38f1592308ebc/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.266695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13126ef6565748bcb057578ea117d34f, user_id=8d67f2fcf09e4c3485b38f1592308ebc, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.269644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de9ea-5f13-4404-88fd-dde58d6e7a36 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.285726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.287490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:01.290521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1244/2494] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:01 2022] PUT /identity/v3/projects/13126ef6565748bcb057578ea117d34f/users/8d67f2fcf09e4c3485b38f1592308ebc/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:01.302299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.303128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.303685 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.328207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:01.335490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] MFA Rules not processed for user `8d67f2fcf09e4c3485b38f1592308ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:01.337321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:01.360383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245ccda-295e-4f04-9602-f273cdeee6a8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.411201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1245/2495] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:01.417689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.419926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.421078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.421618 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.421902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.423957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:01.490243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc317fa-35a3-4bf2-b6cd-edf5433ef8f0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.495080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.495240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.495678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.495949 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.496214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.496542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.496820 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.498762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.506627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1251/2496] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:01.528669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1246/2497] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:01 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:01.530156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.540613 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c1fd1-8a55-4e46-8cea-27205ea3efdd service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.595943 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.596551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.597334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.597600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.598257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.600166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.629461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1252/2498] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:01 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:01.630689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.642176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d1011-10d5-4501-aba8-53421d289e93 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.649185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.649824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.650168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.650585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.651249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.652955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.655264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:01.673262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1247/2499] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:01.674372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.686085 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79310f9-5b75-4f29-b1ed-0317470fd7c4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.691331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.692095 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.692469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.692827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] PATH_INFO: `/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70/users/9ef34cac653a4371991a3b812dc35ccf/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.709188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6fbb9851d7489fb8dfb89e77cffb70, user_id=9ef34cac653a4371991a3b812dc35ccf, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.711979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.727258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1253/2500] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:01 2022] PUT /identity/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70/users/9ef34cac653a4371991a3b812dc35ccf/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:01.731282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.741942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87339a7e-95a5-4d96-a325-8007fa013f35 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.799768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.800366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.800718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.800991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.801632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.803272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daae2b-55cf-4f9e-9b28-68b8ac8656e8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.813058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1248/2501] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:01.817337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.823942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:01.827887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd181a-2ea4-491d-8fe6-2219edad7fc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:01.834262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:01.834922 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.835201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.835474 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] PATH_INFO: `/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70/users/9ef34cac653a4371991a3b812dc35ccf/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.837577 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6fbb9851d7489fb8dfb89e77cffb70, user_id=9ef34cac653a4371991a3b812dc35ccf, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:01.840306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:01.851525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1254/2502] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:01 2022] PUT /identity/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70/users/9ef34cac653a4371991a3b812dc35ccf/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:01.861730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:01.862077 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:01.862359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:01.890062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] MFA Rules not processed for user `9ef34cac653a4371991a3b812dc35ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:01.891281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:01.965758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1249/2503] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:01.976666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:01.978452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:02.038920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47ea15-3170-4ee4-95d5-549007bc2018 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:02.042597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:02.043200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:02.043475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:02.043743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:02.053445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:02.054843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:02.064848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1255/2504] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:02.141002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:02.150983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4005-fe49-4e2b-ac05-dddd327a587e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:02.154952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:02.155545 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:02.155818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:02.156452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:02.213787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:02.215262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:02.225062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1250/2505] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:02.576382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:02.590147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d1d4-8a12-4b0e-85c5-3e2d9702684e service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:02.595175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:02.596007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:02.596290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:02.596593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:02.599796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:02.680768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:02.682585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:02.695021 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1256/2506] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:04.501382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:04.502954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:04.538171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:04.570964 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:04.574689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:04.627683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08b9c-094a-47c2-935e-d516e3ab7505 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:04.632950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:04.633556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:04.633832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:04.634139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:04.636324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:04.649609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:04.651223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:04.663047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1251/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:04.684213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607aacf-b169-43aa-98fc-5dd68fba4fe9 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:04.688738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:04.689368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:04.689647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:04.689941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] PATH_INFO: `/v3/users/21e14b8bcd4442168c2d1b7cfc956dce` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:04.691109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e14b8bcd4442168c2d1b7cfc956dce)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:04.693029 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:04.734214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:04.745267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e14b8bcd4442168c2d1b7cfc956dce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:04.746033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e14b8bcd4442168c2d1b7cfc956dce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:04.758790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e14b8bcd4442168c2d1b7cfc956dce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:04.769040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e14b8bcd4442168c2d1b7cfc956dce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:04.780615 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e14b8bcd4442168c2d1b7cfc956dce'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:04.787121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1257/2508] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:04 2022] DELETE /identity/v3/users/21e14b8bcd4442168c2d1b7cfc956dce => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:04.967823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:04.979316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2161d3-01ab-4d05-9c15-f97ec2a25820 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.027706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.029669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.044561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.045219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.045498 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.045772 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] PATH_INFO: `/v3/projects/58fb14530132434d959da285830fa9b6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.046934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fb14530132434d959da285830fa9b6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.048832 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.097902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fb14530132434d959da285830fa9b6', 'request_id': 'req-173425d8-9900-470d-8cc0-47f6c509cea6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.098475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d8c9-ffdc-43d7-b1c6-7cd6af931340 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.103976 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fb14530132434d959da285830fa9b6', 'request_id': 'req-173425d8-9900-470d-8cc0-47f6c509cea6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.111617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fb14530132434d959da285830fa9b6', 'request_id': 'req-173425d8-9900-470d-8cc0-47f6c509cea6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.123383 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] The token cache is being invalidate because project 58fb14530132434d959da285830fa9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:05.123669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.124343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-173425d8-9900-470d-8cc0-47f6c509cea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.125824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1252/2509] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:04 2022] DELETE /identity/v3/projects/58fb14530132434d959da285830fa9b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:05.131143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287bcd-c86e-479b-a64f-bbd8a7d03d0b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.131421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287bcd-c86e-479b-a64f-bbd8a7d03d0b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.131687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287bcd-c86e-479b-a64f-bbd8a7d03d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.151187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-48287bcd-c86e-479b-a64f-bbd8a7d03d0b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:05.152489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-48287bcd-c86e-479b-a64f-bbd8a7d03d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.160355 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.160983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.161260 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.161530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] PATH_INFO: `/v3/users/8d67f2fcf09e4c3485b38f1592308ebc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.162685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d67f2fcf09e4c3485b38f1592308ebc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.164598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.182998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:05.212399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d67f2fcf09e4c3485b38f1592308ebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.213056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d67f2fcf09e4c3485b38f1592308ebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.215676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1253/2510] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:05.224534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.224819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.225093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.226491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:05.229097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d67f2fcf09e4c3485b38f1592308ebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.238670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d67f2fcf09e4c3485b38f1592308ebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.245290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:05.246187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.246945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-979e4d61-ce9f-41bf-ba1f-00158d7bbd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d67f2fcf09e4c3485b38f1592308ebc'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:05.253531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1258/2511] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:05 2022] DELETE /identity/v3/users/8d67f2fcf09e4c3485b38f1592308ebc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:05.257682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.258066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.258195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1254/2512] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:05.258443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.261812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.271501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5620b-6eaa-4c1c-8178-d9b87f31c105 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.278099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:05.279286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.328366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.329046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.329322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.329592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.330268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:05.330565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.332853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.337750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1259/2513] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:05.344918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1255/2514] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:34:05.349309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.349466 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.350712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.359679 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177588e4-0a29-4465-b91a-9cc8e53c458c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.364352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.364938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.365219 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.365490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.366135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.368478 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.397167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1256/2515] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:05.401575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.416719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff616-6411-4d16-907d-1887f35cc17b None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.469229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.469783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d69e0-2ac0-463f-869e-7c779152d283 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.469903 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.470264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.470534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.477481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.478671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.478955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.479386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.480171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.480296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.481665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.482134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.493014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1260/2516] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:05.512621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1257/2517] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:05.514274 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.524999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284a082-0984-46e4-8590-222f69504088 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.530150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.530760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.531068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.531342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.532004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.533644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.546339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1261/2518] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:05.551076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.561898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e125a-1ecb-4ea7-9006-9ed0124482d6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.570001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.570627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.570911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.571204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.571928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.573543 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05ac2f-cfe0-4cd9-b29a-dfa853bbc3d9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.584730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1258/2519] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:05.589245 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.602315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bcd1c-f165-4c57-ab55-e14a5a366ab6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.607718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.608385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.608668 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.608939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] PATH_INFO: `/v3/projects/0780e30f2e15409f8d0998908d305e0b/users/45e0a7d185b54838a564c26e54f1289c/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.625913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0780e30f2e15409f8d0998908d305e0b, user_id=45e0a7d185b54838a564c26e54f1289c, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.629137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.646503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1262/2520] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:05 2022] PUT /identity/v3/projects/0780e30f2e15409f8d0998908d305e0b/users/45e0a7d185b54838a564c26e54f1289c/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:05.657646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.657646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.657646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.695281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] MFA Rules not processed for user `45e0a7d185b54838a564c26e54f1289c`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:05.696825 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.706827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:05.777044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1259/2521] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:05.797744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.799538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.807898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:05.818674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:05.822128 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:05.918100 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d219f-b443-4722-82ad-5f0afe7f4613 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.918659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a45ff0-6cfd-45db-b9d0-51ecddc4000d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:05.923367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.924198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.924626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.925311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:05.925605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] PATH_INFO: `/v3/projects/13126ef6565748bcb057578ea117d34f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.925896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:05.926219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:05.926642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:05.930380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13126ef6565748bcb057578ea117d34f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.933192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.935176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:05.936795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:05.946725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1263/2522] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:05.998592 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13126ef6565748bcb057578ea117d34f', 'request_id': 'req-336f571b-36ec-4743-a7aa-0082ade028a6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.005268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13126ef6565748bcb057578ea117d34f', 'request_id': 'req-336f571b-36ec-4743-a7aa-0082ade028a6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.015006 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13126ef6565748bcb057578ea117d34f', 'request_id': 'req-336f571b-36ec-4743-a7aa-0082ade028a6'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.027044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] The token cache is being invalidate because project 13126ef6565748bcb057578ea117d34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:06.027267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.027954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.029718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1260/2523] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:05 2022] DELETE /identity/v3/projects/13126ef6565748bcb057578ea117d34f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:06.033518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:06.044658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200bc2-f035-41ff-bdb3-83a5322dad34 service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:06.102434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:06.103096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.103386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.103635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] PATH_INFO: `/v3/users/9ef34cac653a4371991a3b812dc35ccf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.104773 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef34cac653a4371991a3b812dc35ccf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:06.106733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:06.157055 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef34cac653a4371991a3b812dc35ccf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.157723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef34cac653a4371991a3b812dc35ccf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.170431 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef34cac653a4371991a3b812dc35ccf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.178887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef34cac653a4371991a3b812dc35ccf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.186518 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-7e61d96d-3219-4971-a6ce-66f0aa6ef614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef34cac653a4371991a3b812dc35ccf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.193650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1264/2524] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:06 2022] DELETE /identity/v3/users/9ef34cac653a4371991a3b812dc35ccf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:06.484303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:06.485755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:06.506975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f571b-36ec-4743-a7aa-0082ade028a6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:06.545149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:06.565416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:06.566069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.566345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.566612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] PATH_INFO: `/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.567716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6fbb9851d7489fb8dfb89e77cffb70)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:06.569583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:06.616525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6fbb9851d7489fb8dfb89e77cffb70', 'request_id': 'req-dda616fa-0a36-4a00-b7f0-58621122edc0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.622281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6fbb9851d7489fb8dfb89e77cffb70', 'request_id': 'req-dda616fa-0a36-4a00-b7f0-58621122edc0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.629354 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6fbb9851d7489fb8dfb89e77cffb70', 'request_id': 'req-dda616fa-0a36-4a00-b7f0-58621122edc0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.640242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] The token cache is being invalidate because project 4d6fbb9851d7489fb8dfb89e77cffb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:06.640530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.641165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dda616fa-0a36-4a00-b7f0-58621122edc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:06.642666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1261/2525] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:06 2022] DELETE /identity/v3/projects/4d6fbb9851d7489fb8dfb89e77cffb70 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:06.647503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.647984 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.648087 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.662295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:06.790370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:06.792071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:06.849981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1265/2526] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:06.857899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.858213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.858483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.878226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:06.879421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:06.887055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1262/2527] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:06.891097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:06.901462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5818c-5122-44cc-a798-2c739eca4097 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:06.905923 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:06.906538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.906810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.907075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.907710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:06.908030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:06.910181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:06.922076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1266/2528] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:06.926916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:06.936297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80745a-7d12-458a-88d9-1cb2b99dcc44 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:06.940884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:06.941477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:06.941755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:06.942083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:06.942710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:06.944597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:06.971018 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1263/2529] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:06 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:06.975593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:06.985255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30030882-c562-4844-8293-4cc12183ac85 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.041581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.042219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.042494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.046318 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.047004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.048918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.069417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1267/2530] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:06 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:07.073483 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.084271 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400a391-c3e4-4771-84de-56f72311069e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.088843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.089432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.089710 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.090012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.090676 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.092251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.102539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1264/2531] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:34:07.106114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.115856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4782d3-e359-441b-8dd3-555b118435bc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.120606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.121202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.121472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.121734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.122393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.123953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12e08-adf6-4641-8f4d-ba6dd4871bbd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.134370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1268/2532] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:07.138086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.148782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd6c51-141c-4216-a8f9-a7a9d407bcd3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.153348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.153982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.154275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.154546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] PATH_INFO: `/v3/projects/054254abc3564ca39557f3273e975ccf/users/d04fff084b564997b07802718eb57c21/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.169875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=054254abc3564ca39557f3273e975ccf, user_id=d04fff084b564997b07802718eb57c21, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.172588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.185197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1265/2533] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:07 2022] PUT /identity/v3/projects/054254abc3564ca39557f3273e975ccf/users/d04fff084b564997b07802718eb57c21/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:07.196681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.196975 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.197248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.225649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] MFA Rules not processed for user `d04fff084b564997b07802718eb57c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:07.226894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:07.289909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1269/2534] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:07.294392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.354125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdcf22-95b2-43ca-b7c0-09ca9f892e0f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.358754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.359363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.359631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.359902 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.360528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.362823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.374563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:07.392778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1266/2535] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:07 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:07.397506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.403110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:07.410138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e75b-ac1b-4ea7-887a-ef98c61723f7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.467673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.468280 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.468558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.468826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.469445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.471433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.496183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1270/2536] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:07 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:07.497406 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.508295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0b030-d65c-4066-bca1-c0e753029ce5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.512962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.513564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.513847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.514156 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.514968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.516565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.528955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1267/2537] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:07.533091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.543214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96a0c9-c808-4b34-8aee-e3e8fbf5b7f2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.547966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.548617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.548896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.549165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] PATH_INFO: `/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4/users/39d929c752364bdb9aec7692a906b413/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.564084 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee71ac1167b43d29d2ef2bb1e43c0c4, user_id=39d929c752364bdb9aec7692a906b413, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.567322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.579748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1271/2538] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:07 2022] PUT /identity/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4/users/39d929c752364bdb9aec7692a906b413/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:07.584366 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.594185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097c7b-c806-49f8-a53e-3ae148892e27 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.649154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.649712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.650035 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.650363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.651308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.652888 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe2cf-729f-4e95-80a2-bfbd742408f6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.662379 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1268/2539] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:07.666491 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.677072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb93a7-5c72-44b3-bc78-6462447bef67 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.681685 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.682351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.682626 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.682890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] PATH_INFO: `/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4/users/39d929c752364bdb9aec7692a906b413/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.684756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee71ac1167b43d29d2ef2bb1e43c0c4, user_id=39d929c752364bdb9aec7692a906b413, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.687408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.698056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1272/2540] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:07 2022] PUT /identity/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4/users/39d929c752364bdb9aec7692a906b413/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:07.708221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.708513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.708792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.735978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] MFA Rules not processed for user `39d929c752364bdb9aec7692a906b413`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:07.737708 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:07.804343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1269/2541] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:07.817718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:07.819447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:07.875096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8350ca-2f93-4c7e-b576-0026dddb2fcc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:07.879271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:07.879859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:07.880137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:07.880408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:07.889138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:07.890609 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:07.900556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1273/2542] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:08.205303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:08.214409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5f80-4413-4584-975c-ec10530a02d7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:08.219096 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d929c752364bdb9aec7692a906b413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:08.219693 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.219972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.220244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.220884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:08.221180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:08.223306 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:08.234631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1270/2543] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:08.239350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:08.248700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78353e7f-b3a7-4076-a965-710f9cfc9c50 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:08.253232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d929c752364bdb9aec7692a906b413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:08.253825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.254144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.254418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.255032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:08.256915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:08.282258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1274/2544] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:08 2022] POST /identity/v3/projects => generated 354 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:08.286828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:08.296464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151072c-339b-4f2c-9067-3161c9aacdb2 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:08.339618 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:08.353239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d929c752364bdb9aec7692a906b413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:08.353850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.354157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.354555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.355065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:08.355363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:08.356946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:08.370019 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1271/2545] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:08.405723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:08.416388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387b36-fe44-443a-8032-8c4a0b690230 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:08.420810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d929c752364bdb9aec7692a906b413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:08.421425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.421703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.421997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] PATH_INFO: `/v3/projects/487ccd53a5ea4420be2d87fc82f23632` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.423112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorizing `identity:delete_project(project_id=487ccd53a5ea4420be2d87fc82f23632)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:08.425641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:08.462999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:08.481728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487ccd53a5ea4420be2d87fc82f23632', 'request_id': 'req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.488588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487ccd53a5ea4420be2d87fc82f23632', 'request_id': 'req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.498316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487ccd53a5ea4420be2d87fc82f23632', 'request_id': 'req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.512188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] The token cache is being invalidate because project 487ccd53a5ea4420be2d87fc82f23632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:08.512475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.513146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ef9ef861-6e96-46a9-b6c1-b157bd7694ed tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.514770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1275/2546] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:08 2022] DELETE /identity/v3/projects/487ccd53a5ea4420be2d87fc82f23632 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:08.708660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:08.710546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:08.777493 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c6091-95cd-453c-b2cc-a7f142829c38 tempest-VolumeQuotaClassesTest-1088705105 tempest-VolumeQuotaClassesTest-1088705105-project-admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:08.835766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:08.836430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.836680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.836935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] PATH_INFO: `/v3/users/d04fff084b564997b07802718eb57c21` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.838174 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04fff084b564997b07802718eb57c21)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:08.840132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:08.886106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04fff084b564997b07802718eb57c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.886787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04fff084b564997b07802718eb57c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.899202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04fff084b564997b07802718eb57c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.899837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04fff084b564997b07802718eb57c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.906752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04fff084b564997b07802718eb57c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:08.918801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1272/2547] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:08 2022] DELETE /identity/v3/users/d04fff084b564997b07802718eb57c21 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:08.923340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:08.923839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:08.923968 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:08.942393 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:08.943566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:09.000461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1276/2548] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:09.011126 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:09.012540 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:09.023887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:09.072664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60970e5-cf65-4519-99fa-14d78805a193 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:09.077291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:09.077291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:09.077291 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:09.077716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:09.087831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:09.089410 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:09.102347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1273/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:09.419490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:09.420974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:09.438988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d835c95-9f5b-4999-897f-e2a785f65ad3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:09.448463 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:09.449334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:09.449505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:09.449780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] PATH_INFO: `/v3/projects/054254abc3564ca39557f3273e975ccf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:09.451358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054254abc3564ca39557f3273e975ccf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:09.453325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:09.502063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054254abc3564ca39557f3273e975ccf', 'request_id': 'req-a435f45b-08d8-49f8-9750-cfb6cc7ad318'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.515771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054254abc3564ca39557f3273e975ccf', 'request_id': 'req-a435f45b-08d8-49f8-9750-cfb6cc7ad318'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.540136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054254abc3564ca39557f3273e975ccf', 'request_id': 'req-a435f45b-08d8-49f8-9750-cfb6cc7ad318'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.555713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] The token cache is being invalidate because project 054254abc3564ca39557f3273e975ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:09.556077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.556838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.558672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1277/2550] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:09 2022] DELETE /identity/v3/projects/054254abc3564ca39557f3273e975ccf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:09.562935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:09.572792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2cc9-5bea-46dd-b17d-aba772479d7c service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:09.635701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:09.636329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:09.636625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:09.636890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] PATH_INFO: `/v3/users/39d929c752364bdb9aec7692a906b413` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:09.638011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d929c752364bdb9aec7692a906b413)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:09.639923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:09.688907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d929c752364bdb9aec7692a906b413'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.689554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d929c752364bdb9aec7692a906b413'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.704220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d929c752364bdb9aec7692a906b413'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.704810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d929c752364bdb9aec7692a906b413'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.714175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b52d5457-9574-4eef-9d79-920c8a5c7f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d929c752364bdb9aec7692a906b413'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:09.727267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1274/2551] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:09 2022] DELETE /identity/v3/users/39d929c752364bdb9aec7692a906b413 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:09.999227 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.000757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:10.014600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435f45b-08d8-49f8-9750-cfb6cc7ad318 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.055138 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:10.073401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.074063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.074340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.074606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] PATH_INFO: `/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.075709 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee71ac1167b43d29d2ef2bb1e43c0c4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.077587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.121843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'request_id': 'req-bfeba4d1-5052-435b-a1b5-a85184ca38bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:10.127289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'request_id': 'req-bfeba4d1-5052-435b-a1b5-a85184ca38bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:10.134809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee71ac1167b43d29d2ef2bb1e43c0c4', 'request_id': 'req-bfeba4d1-5052-435b-a1b5-a85184ca38bb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:10.145372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] The token cache is being invalidate because project 1ee71ac1167b43d29d2ef2bb1e43c0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:10.145643 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:10.146284 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-bfeba4d1-5052-435b-a1b5-a85184ca38bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:10.147741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1278/2552] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:09 2022] DELETE /identity/v3/projects/1ee71ac1167b43d29d2ef2bb1e43c0c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:10.152636 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.152991 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.153367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.172215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:10.173401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:10.199293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:10.231900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1275/2553] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:10.240159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.240470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.240742 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.260743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:10.261870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:10.269635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1279/2554] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:10.273658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.283073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc2c87-6fa9-43d1-b091-84d6d7223a6e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.288089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.288674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.288947 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.289213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.289841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:10.290171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.291738 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.304038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1276/2555] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:10.307758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.316703 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fba759-be92-4660-96ed-cb515dfd6c6f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.321213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.321785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.322082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.322349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.322949 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.324809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.354003 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1280/2556] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:10.358237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.369118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed6cbb-ea12-457e-aa03-591cad60cc80 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.425409 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.426042 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.426325 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.426597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.427230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.429348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.450453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1277/2557] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:10.455249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.465570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec2217-db50-42af-af08-8df1a099a2c2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.470053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.470677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.470947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.471232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.472350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.473919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.483761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1281/2558] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:10.488173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.498185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de4c76-5c37-4051-919a-d8f949862534 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.502893 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.503486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.503763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.504039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.505121 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.506751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd7ec2-94cf-4dd8-9bfd-9098c0167069 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.517222 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1278/2559] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:10.521161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.531293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60ca93-fcee-46e4-a602-aaed8dc5b9fb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.536765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.537321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.537592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.537856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] PATH_INFO: `/v3/projects/4b17116a581d4fe7879ab8726a900180/users/64962e82d8bf456d928f8b47a4ab0d0d/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.553143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b17116a581d4fe7879ab8726a900180, user_id=64962e82d8bf456d928f8b47a4ab0d0d, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.555799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.569377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1282/2560] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:10 2022] PUT /identity/v3/projects/4b17116a581d4fe7879ab8726a900180/users/64962e82d8bf456d928f8b47a4ab0d0d/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:10.580371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.580715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.580915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.608056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] MFA Rules not processed for user `64962e82d8bf456d928f8b47a4ab0d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:10.609242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:10.671518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1279/2561] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:10.676684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.735899 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a855-633e-498b-abbf-0ccfcfd7b5e2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.740433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.741028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.741300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.741566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.742462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.744338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.757644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:10.771146 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1283/2562] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:10.775408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.786660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f12a0-cb8e-4534-8ad6-22c833174088 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.810937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:10.850437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.851065 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.851344 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.851616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.852229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.854185 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.874034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1280/2563] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:10 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:10.877991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.888208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1418-007e-4fca-8cab-1227dfb94144 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.892717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.893806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.894117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.894384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.895009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.896833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.907039 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1284/2564] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:10.911546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.921345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141892-db1b-4831-9ebe-7cfa89af7553 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:10.925955 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:10.926622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:10.926907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:10.927181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] PATH_INFO: `/v3/projects/76c7385e8fe345b2bbbb70899cfae667/users/ae47ea551443457e811796cd252cdef4/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:10.942905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c7385e8fe345b2bbbb70899cfae667, user_id=ae47ea551443457e811796cd252cdef4, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:10.945607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:10.958994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1281/2565] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:10 2022] PUT /identity/v3/projects/76c7385e8fe345b2bbbb70899cfae667/users/ae47ea551443457e811796cd252cdef4/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:10.962829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:10.973456 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3c0b1-9049-432b-a60b-a81c3c0dd38e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:11.029579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:11.030219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:11.030404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:11.030678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:11.031307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:11.032898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8daa7b-593c-4706-8466-92b2dafdef8e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:11.042973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1285/2566] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:11.047106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:11.057324 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028905a5-37c4-4b9d-a341-2eaa13a125f7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:11.061827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:11.062507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:11.062782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:11.063046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] PATH_INFO: `/v3/projects/76c7385e8fe345b2bbbb70899cfae667/users/ae47ea551443457e811796cd252cdef4/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:11.064898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c7385e8fe345b2bbbb70899cfae667, user_id=ae47ea551443457e811796cd252cdef4, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:11.068040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:11.077796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1282/2567] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:11 2022] PUT /identity/v3/projects/76c7385e8fe345b2bbbb70899cfae667/users/ae47ea551443457e811796cd252cdef4/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:11.088246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:11.088535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:11.088810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:11.117562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] MFA Rules not processed for user `ae47ea551443457e811796cd252cdef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:11.118787 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:11.184188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1286/2568] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:11 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:11.194833 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:11.196517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:11.252894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e1698-61b8-4812-ac8c-e5b72d22ea9a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:11.256487 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:11.257076 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:11.257350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:11.257616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:11.266305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:11.267709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8893d8-05d5-4c92-951a-598e39cb29ea service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:11.276808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1283/2569] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:11.355352 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:11.366030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02291fe5-5cc0-4eb7-8aaa-14c835cbdde5 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:11.370106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:11.370707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:11.370980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:11.371246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:11.426776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:11.428187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:11.438349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1287/2570] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:11 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:14.877997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff560-1f51-4d8e-bdfb-eb076dee71b0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:14.878555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff560-1f51-4d8e-bdfb-eb076dee71b0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:14.878844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cff560-1f51-4d8e-bdfb-eb076dee71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:14.898804 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-67cff560-1f51-4d8e-bdfb-eb076dee71b0 None None] MFA Rules not processed for user `b2e79830079c4aa9b95c4622bac45c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:14.900028 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-67cff560-1f51-4d8e-bdfb-eb076dee71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:14.962977 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1284/2571] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:15.098879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:15.098879 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:15.104914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:15.205235 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef2199-47c2-4fa6-88ea-6eead636e207 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:15.213715 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:15.214486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:15.214826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:15.215160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] PATH_INFO: `/v3/users/45e0a7d185b54838a564c26e54f1289c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:15.217384 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e0a7d185b54838a564c26e54f1289c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:15.219486 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:15.304123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e0a7d185b54838a564c26e54f1289c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.304909 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e0a7d185b54838a564c26e54f1289c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.321134 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e0a7d185b54838a564c26e54f1289c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.330065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e0a7d185b54838a564c26e54f1289c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.337412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e0a7d185b54838a564c26e54f1289c'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.344006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1288/2572] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:15 2022] DELETE /identity/v3/users/45e0a7d185b54838a564c26e54f1289c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:15.351607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:15.351988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:15.352337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:15.373792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:15.375110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:15.396264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:15.445617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1285/2573] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:15.453128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:15.454704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:15.514162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997149-b628-4f27-a2ed-ca092e137160 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:15.517754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:15.518467 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:15.518744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:15.519014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:15.529366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:15.530892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d793a8d-0c07-43c3-a1a5-09ff705edf62 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:15.541059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1289/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:15.828501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:15.830113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:15.842505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34617973-4691-4d9c-b844-aa63350904f3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:15.851837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:15.852612 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:15.852960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:15.853303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] PATH_INFO: `/v3/projects/0780e30f2e15409f8d0998908d305e0b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:15.854678 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0780e30f2e15409f8d0998908d305e0b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:15.856873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:15.926421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0780e30f2e15409f8d0998908d305e0b', 'request_id': 'req-de464514-51fd-49db-a68e-82ffbf221673'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.932233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0780e30f2e15409f8d0998908d305e0b', 'request_id': 'req-de464514-51fd-49db-a68e-82ffbf221673'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.942937 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0780e30f2e15409f8d0998908d305e0b', 'request_id': 'req-de464514-51fd-49db-a68e-82ffbf221673'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.954223 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] The token cache is being invalidate because project 0780e30f2e15409f8d0998908d305e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:15.954516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.955154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-de464514-51fd-49db-a68e-82ffbf221673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:15.957190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1286/2575] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:15 2022] DELETE /identity/v3/projects/0780e30f2e15409f8d0998908d305e0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:15.962025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:15.962308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:15.962576 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:15.983157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:15.984354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:16.003326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:16.049375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1290/2576] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:16.057103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.057547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.057946 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.077342 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:16.078563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:16.087488 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1287/2577] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:16.091734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.104057 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36429361-f8ec-431f-b409-bc28ab3933ce None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.108786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.109382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.109658 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.109919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.110581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:16.110874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.112441 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.124777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1291/2578] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:16.129176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.138284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadce1d-8715-4c60-851a-9cde2ec094b8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.143739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.144330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.144607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.144881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.145497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.147428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.179497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1288/2579] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:16.180935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.192833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a9cef-75d3-4a63-92aa-fafb1950076e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.252325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.252865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.253142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.253416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.254140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.256116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.278727 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1292/2580] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:16.282913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.296193 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbdfaf-6ee6-48b3-b45b-31dc74a055cd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.300996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.301600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.301881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.302191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.302844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.304418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.315391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1289/2581] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:34:16.319597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.330225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15e0d4-59f3-4168-bd5f-5dc05b44a06b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.337109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.337794 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.338281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.338536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.339513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.341597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4efe99-f6e0-4ee4-8653-57d0c8bce623 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.357799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1293/2582] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:16.362531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.379593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b879-bbd8-4108-b47a-d8887441ea58 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.384699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.385440 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.385787 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.386168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] PATH_INFO: `/v3/projects/70e2c674ec454435b9c30742623b2556/users/612d00f2ded84fa8b47e9a32c45b838b/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.418607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e2c674ec454435b9c30742623b2556, user_id=612d00f2ded84fa8b47e9a32c45b838b, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.421735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.441630 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1290/2583] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:16 2022] PUT /identity/v3/projects/70e2c674ec454435b9c30742623b2556/users/612d00f2ded84fa8b47e9a32c45b838b/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:16.456834 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.457186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.457461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.492756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] MFA Rules not processed for user `612d00f2ded84fa8b47e9a32c45b838b`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:16.494112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:16.564418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1294/2584] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:16.569496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.620253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:16.637330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec83fb6-ca30-41a2-9519-dcc38924851f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.642002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.642608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.642889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.643743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.644376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.646573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.673894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1291/2585] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:16.678833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.690901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179e561-49ba-438a-b800-c1cd85c69225 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.707308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:16.753498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.754175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.754450 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.754720 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.755402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.757298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.780254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1295/2586] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:16 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:16.784197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.795650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255d682-a114-49d5-82ab-f77a3fc010ea admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.801352 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.801953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.802261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.802530 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.803199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.804793 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.817622 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1292/2587] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:34:16.821638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.834678 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098bd3-7d82-47b2-a961-ed71051f7cc5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.841171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.842026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.842395 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.842757 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] PATH_INFO: `/v3/projects/61839123631b4be4a83c33caabc4c7fb/users/2600add0431d49d6a6143b51cf34d978/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.860432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61839123631b4be4a83c33caabc4c7fb, user_id=2600add0431d49d6a6143b51cf34d978, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.864008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.881487 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1296/2588] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:16 2022] PUT /identity/v3/projects/61839123631b4be4a83c33caabc4c7fb/users/2600add0431d49d6a6143b51cf34d978/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:16.885292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.895918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1fce0-be4c-414e-8de5-52f10ba4117c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.963047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:16.963725 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:16.963927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:16.964195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:16.964834 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:16.966443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af44399-8941-43af-b1e3-5c653eff0043 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:16.980624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1293/2589] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:16.981732 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:16.994716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864971a8-e69d-47f0-859f-62b1a327dadb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:16.999870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.000523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.000843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.001114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] PATH_INFO: `/v3/projects/61839123631b4be4a83c33caabc4c7fb/users/2600add0431d49d6a6143b51cf34d978/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.003785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61839123631b4be4a83c33caabc4c7fb, user_id=2600add0431d49d6a6143b51cf34d978, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.006616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.027156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1297/2590] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:16 2022] PUT /identity/v3/projects/61839123631b4be4a83c33caabc4c7fb/users/2600add0431d49d6a6143b51cf34d978/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:17.040828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.041118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.041394 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.071009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] MFA Rules not processed for user `2600add0431d49d6a6143b51cf34d978`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:17.072293 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.145320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1294/2591] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:17.157410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.160139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.219600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b1978-0241-4e1f-81a7-e1f52897bf13 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.223837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.224462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.224733 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.224998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.234766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.236248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d022e-bf3e-43bd-b0f3-1d838a71eece service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.247669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1298/2592] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:17.277548 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.335397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:17.358082 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b4fd-0e10-4016-923f-69cc408c8443 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.363657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.364398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.364920 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.365261 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] PATH_INFO: `/v3/users/612d00f2ded84fa8b47e9a32c45b838b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.368279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612d00f2ded84fa8b47e9a32c45b838b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.372242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.435674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612d00f2ded84fa8b47e9a32c45b838b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.436894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612d00f2ded84fa8b47e9a32c45b838b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.450940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612d00f2ded84fa8b47e9a32c45b838b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.451701 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612d00f2ded84fa8b47e9a32c45b838b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.460960 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612d00f2ded84fa8b47e9a32c45b838b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.484010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1295/2593] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:17 2022] DELETE /identity/v3/users/612d00f2ded84fa8b47e9a32c45b838b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:17.488992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.489370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.489691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.511295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:17.512170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.513183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.513537 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.602523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb85f-8d4b-4324-8c6d-d0095d3f5eb2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.609461 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.610173 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.610446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.610718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] PATH_INFO: `/v3/users/e55f8134be4a44bba1cc238eaf4e8093` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.612280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55f8134be4a44bba1cc238eaf4e8093)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.617375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.634503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1299/2594] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:17.652880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.656163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.701430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55f8134be4a44bba1cc238eaf4e8093'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.702198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55f8134be4a44bba1cc238eaf4e8093'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.708131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:17.725226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:17.727101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55f8134be4a44bba1cc238eaf4e8093'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.729061 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55f8134be4a44bba1cc238eaf4e8093'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.745454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-010b6065-c1b2-40fe-8435-2db6ed593975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55f8134be4a44bba1cc238eaf4e8093'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.779080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1296/2595] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:17 2022] DELETE /identity/v3/users/e55f8134be4a44bba1cc238eaf4e8093 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:17.785242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.785660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.786069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.786955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27903ba-8d3f-48b8-8d7a-a050e70cda39 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.816203 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:17.817841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.875686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.876329 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.876611 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.876901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.879323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.911317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1297/2596] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:17.912604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.917194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.930481 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918583b1-7d47-484f-b8e2-f784d9f726b3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.935609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.936264 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.936531 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.936808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] PATH_INFO: `/v3/users/64962e82d8bf456d928f8b47a4ab0d0d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.938029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64962e82d8bf456d928f8b47a4ab0d0d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.940699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.963982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:17.966096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:17.978253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1300/2597] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:17.979267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:17.980734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:17.991739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67ae2b-dd49-40d1-8d8d-b7933f0d216f service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:17.996249 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:17.997219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:17.997508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:17.997626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64962e82d8bf456d928f8b47a4ab0d0d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:17.998075 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:17.998609 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64962e82d8bf456d928f8b47a4ab0d0d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.009381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.010861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee059ec9-e712-444b-bdcc-5fe4303df61a service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.016482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64962e82d8bf456d928f8b47a4ab0d0d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.017467 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64962e82d8bf456d928f8b47a4ab0d0d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.023876 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1301/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:18.028912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64962e82d8bf456d928f8b47a4ab0d0d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.050881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1298/2599] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:17 2022] DELETE /identity/v3/users/64962e82d8bf456d928f8b47a4ab0d0d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:18.056136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.056429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.056897 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.086584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:18.087948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.164483 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1302/2600] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:18.184810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:18.186377 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.259162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89ebdf-d7ff-4d70-8bc3-74f116b48e4f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:18.263253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:18.263871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.264253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.264529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.273034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:18.277699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.279213 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.291838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1299/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:18.610194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:18.611340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.628859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9da90-877b-46b2-ad00-0c79ff36d3bf None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:18.635585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:18.640186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.640652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.640836 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] PATH_INFO: `/v3/projects/70e2c674ec454435b9c30742623b2556` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.643058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e2c674ec454435b9c30742623b2556)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.645499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.648585 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:18.656650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:18.660730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.686646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c651-9768-471e-84be-dc3130a27a81 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:18.699398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:18.701017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.701508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.701994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] PATH_INFO: `/v3/projects/1c50e742db254ac0ac140fe991d6b2d6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.704179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c50e742db254ac0ac140fe991d6b2d6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.706623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.711459 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e2c674ec454435b9c30742623b2556', 'request_id': 'req-c004fa64-68a2-4e33-8ff1-d5da44552bf6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.718683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e2c674ec454435b9c30742623b2556', 'request_id': 'req-c004fa64-68a2-4e33-8ff1-d5da44552bf6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.729672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e2c674ec454435b9c30742623b2556', 'request_id': 'req-c004fa64-68a2-4e33-8ff1-d5da44552bf6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.745661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] The token cache is being invalidate because project 70e2c674ec454435b9c30742623b2556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:18.746221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.747348 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.749691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1303/2602] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:18 2022] DELETE /identity/v3/projects/70e2c674ec454435b9c30742623b2556 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:18.753726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:18.755271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.775110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c50e742db254ac0ac140fe991d6b2d6', 'request_id': 'req-eabf259d-234e-4555-890c-8074b7281e7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.781497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c50e742db254ac0ac140fe991d6b2d6', 'request_id': 'req-eabf259d-234e-4555-890c-8074b7281e7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.798680 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c50e742db254ac0ac140fe991d6b2d6', 'request_id': 'req-eabf259d-234e-4555-890c-8074b7281e7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.812663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] The token cache is being invalidate because project 1c50e742db254ac0ac140fe991d6b2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:18.812951 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.813638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.815327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1300/2603] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:18 2022] DELETE /identity/v3/projects/1c50e742db254ac0ac140fe991d6b2d6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:18.819847 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:18.822546 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:18.876662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004fa64-68a2-4e33-8ff1-d5da44552bf6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:18.916157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf259d-234e-4555-890c-8074b7281e7c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:18.921768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:18.922656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.923839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.925003 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] PATH_INFO: `/v3/users/5639e716995744178483aaf47f11739a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.926555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5639e716995744178483aaf47f11739a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.932823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.958888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:18.959428 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:18.960434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:18.960851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] PATH_INFO: `/v3/users/2600add0431d49d6a6143b51cf34d978` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:18.962400 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2600add0431d49d6a6143b51cf34d978)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:18.964786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:18.991631 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5639e716995744178483aaf47f11739a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:18.992286 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5639e716995744178483aaf47f11739a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.005742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5639e716995744178483aaf47f11739a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.006527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5639e716995744178483aaf47f11739a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.015045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5639e716995744178483aaf47f11739a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.023900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:19.025751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:19.032262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1301/2604] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:18 2022] DELETE /identity/v3/users/5639e716995744178483aaf47f11739a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:19.034179 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:19.036296 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.039189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2600add0431d49d6a6143b51cf34d978'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.040207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2600add0431d49d6a6143b51cf34d978'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.057114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2600add0431d49d6a6143b51cf34d978'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.066953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2600add0431d49d6a6143b51cf34d978'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.076754 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2600add0431d49d6a6143b51cf34d978'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.089248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1304/2605] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:18 2022] DELETE /identity/v3/users/2600add0431d49d6a6143b51cf34d978 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:19.114705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a15a9-982a-445f-9314-c36275bb992a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:19.176687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:19.177768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.178273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.178729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] PATH_INFO: `/v3/projects/4b17116a581d4fe7879ab8726a900180` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.180084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b17116a581d4fe7879ab8726a900180)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:19.182555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:19.241674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b17116a581d4fe7879ab8726a900180', 'request_id': 'req-69adddff-1930-41ef-8bda-a257dc1a5c51'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.254600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b17116a581d4fe7879ab8726a900180', 'request_id': 'req-69adddff-1930-41ef-8bda-a257dc1a5c51'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.264733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b17116a581d4fe7879ab8726a900180', 'request_id': 'req-69adddff-1930-41ef-8bda-a257dc1a5c51'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.280074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] The token cache is being invalidate because project 4b17116a581d4fe7879ab8726a900180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:19.280607 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.286031 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.287615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1302/2606] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:19 2022] DELETE /identity/v3/projects/4b17116a581d4fe7879ab8726a900180 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:19.291672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:19.293485 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.310701 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecb15-e73f-428e-b10f-8d1668a1a3b6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:19.403870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:19.404892 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.405498 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.406141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] PATH_INFO: `/v3/users/ae47ea551443457e811796cd252cdef4` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.407774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae47ea551443457e811796cd252cdef4)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:19.409995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:19.469777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae47ea551443457e811796cd252cdef4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.471082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae47ea551443457e811796cd252cdef4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.486024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae47ea551443457e811796cd252cdef4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.498140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae47ea551443457e811796cd252cdef4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.509399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae47ea551443457e811796cd252cdef4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.524114 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1305/2607] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:19 2022] DELETE /identity/v3/users/ae47ea551443457e811796cd252cdef4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:19.552093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:19.553715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.568504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adddff-1930-41ef-8bda-a257dc1a5c51 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:19.590128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:19.594356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.644731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:19.684608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:19.686315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:19.687463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.688691 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.688973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] PATH_INFO: `/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.691794 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2761ea16cf46f8a69a0b7c8443afcd)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:19.695836 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:19.722140 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6990351-5810-4380-a45e-2d1073622378 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:19.727652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:19.729015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.729302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.729582 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] PATH_INFO: `/v3/projects/61839123631b4be4a83c33caabc4c7fb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.731302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=61839123631b4be4a83c33caabc4c7fb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:19.734500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:19.763425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2761ea16cf46f8a69a0b7c8443afcd', 'request_id': 'req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.796399 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2761ea16cf46f8a69a0b7c8443afcd', 'request_id': 'req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.802186 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61839123631b4be4a83c33caabc4c7fb', 'request_id': 'req-6e4f8234-c2c3-484f-99ba-7215da61a6fa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.809628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2761ea16cf46f8a69a0b7c8443afcd', 'request_id': 'req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.810313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61839123631b4be4a83c33caabc4c7fb', 'request_id': 'req-6e4f8234-c2c3-484f-99ba-7215da61a6fa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.820305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61839123631b4be4a83c33caabc4c7fb', 'request_id': 'req-6e4f8234-c2c3-484f-99ba-7215da61a6fa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.831837 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] The token cache is being invalidate because project ff2761ea16cf46f8a69a0b7c8443afcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:19.832133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.833181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ec52cdc-cff0-4c9c-b3be-47b81cfe96ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.835084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1303/2608] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:19 2022] DELETE /identity/v3/projects/ff2761ea16cf46f8a69a0b7c8443afcd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:19.836117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] The token cache is being invalidate because project 61839123631b4be4a83c33caabc4c7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:19.836472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.837244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6e4f8234-c2c3-484f-99ba-7215da61a6fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:19.839118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1306/2609] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:19 2022] DELETE /identity/v3/projects/61839123631b4be4a83c33caabc4c7fb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:19.839819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9366a-d7d0-4753-9591-b93e8bb5dbfd None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.840290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9366a-d7d0-4753-9591-b93e8bb5dbfd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.840764 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9366a-d7d0-4753-9591-b93e8bb5dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.844430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.844714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.844983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.863089 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-14e9366a-d7d0-4753-9591-b93e8bb5dbfd None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:19.864381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-14e9366a-d7d0-4753-9591-b93e8bb5dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.869252 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:19.870588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.946072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1307/2610] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:19.947383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:19.949657 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.958107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1304/2611] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:19.959856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d607-4a69-4a8c-b2ec-bd4db108fb34 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.960359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d607-4a69-4a8c-b2ec-bd4db108fb34 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.960689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d607-4a69-4a8c-b2ec-bd4db108fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.963262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d171-0418-4dc1-9485-4aeb4c9766bb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:19.970091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:19.970789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.971169 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.971446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] PATH_INFO: `/v3/projects/76c7385e8fe345b2bbbb70899cfae667` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:19.972659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c7385e8fe345b2bbbb70899cfae667)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:19.974647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:19.982331 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e268d607-4a69-4a8c-b2ec-bd4db108fb34 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:19.983041 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e268d607-4a69-4a8c-b2ec-bd4db108fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:19.992237 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1305/2612] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:19.993547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1210c-73af-4399-be1f-9c08618c7c9d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:19.993765 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1210c-73af-4399-be1f-9c08618c7c9d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:19.994069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1210c-73af-4399-be1f-9c08618c7c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.013930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-67a1210c-73af-4399-be1f-9c08618c7c9d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.015199 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-67a1210c-73af-4399-be1f-9c08618c7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.030070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c7385e8fe345b2bbbb70899cfae667', 'request_id': 'req-cfeff253-2160-4387-835b-0507b0bec108'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:20.039118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c7385e8fe345b2bbbb70899cfae667', 'request_id': 'req-cfeff253-2160-4387-835b-0507b0bec108'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:20.043916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.055885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c7385e8fe345b2bbbb70899cfae667', 'request_id': 'req-cfeff253-2160-4387-835b-0507b0bec108'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:20.070579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.073893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] The token cache is being invalidate because project 76c7385e8fe345b2bbbb70899cfae667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:20.074307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:20.075074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:20.076926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1308/2613] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:19 2022] DELETE /identity/v3/projects/76c7385e8fe345b2bbbb70899cfae667 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:20.077524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.079014 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.081877 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1306/2614] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:20.086418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.087066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.087842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.093550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeff253-2160-4387-835b-0507b0bec108 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.098972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.099697 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.100132 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.100412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.101065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:20.101368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.103006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.109523 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.110875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.116851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1309/2615] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:20.119988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1307/2616] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:20.121148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.121464 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.133647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1834c-9cae-4f95-82b0-3226de5ee31d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.136181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fbfa3-a6f9-4416-b08f-8b2b1ba049bc admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.139332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.139961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.140238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.140539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.141070 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.141192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.141670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.141944 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.142237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.142933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:20.143086 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.143359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.144941 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab707fc4-2e47-4571-9346-09b710c02bce admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.159695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1310/2617] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:20.161786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480421f-0c36-483f-a74a-409c24998964 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.162223 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480421f-0c36-483f-a74a-409c24998964 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.162580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480421f-0c36-483f-a74a-409c24998964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.176059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1308/2618] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:20.178897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.186589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c480421f-0c36-483f-a74a-409c24998964 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.187833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c480421f-0c36-483f-a74a-409c24998964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.248144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb282246-90d5-4939-8f5a-f8d45cf31731 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.249751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1311/2619] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:20.250738 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480421f-0c36-483f-a74a-409c24998964 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.256004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.256740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.257029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.257302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.257985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.259905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480421f-0c36-483f-a74a-409c24998964 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.260036 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.264677 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.265273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.265546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.265815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.266475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.268398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.291665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1309/2620] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:20.291665 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.291976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1312/2621] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:20.293649 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.303931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753be3a-830a-4aca-9644-3d7740b901ad admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.354330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084494-e242-4fa1-8745-1d6acbfdfcba admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.359010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.359436 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.359620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.359900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.360037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.360172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.360311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.360573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.360810 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:20.361119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.361240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.363311 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.363743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.379284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1310/2622] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:20.379968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.385553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1313/2623] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:20.386572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.392242 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f93e3-c429-4494-950b-a35c25e8b33c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.396402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66970083-4255-4ed1-b315-c389c5367505 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.397241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.397914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.398241 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.398512 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.399144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.400724 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.401376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.401948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.402255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.402521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.403123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.404977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.412221 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1311/2624] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.412870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.423371 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01881d-8fb0-44e8-b222-aa80eaeadc8b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.428749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.429340 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.429611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.429879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.430542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.432214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.433655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1314/2625] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:20.434523 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.446046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1312/2626] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.446046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.451411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.457172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed3966-d50f-4ad5-a36d-2a602dde0862 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.483220 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.500255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ec57-2ca7-4b05-b9a6-b7a9c981eef5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.504980 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.505579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.505856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.506165 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.506804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.508409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.515177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.515796 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.516207 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.516339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.516982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.519137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1315/2627] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.519432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.519768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.529282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16ede-60ff-4135-ad97-8aaf4ed93b28 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.535116 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.535786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.536067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.536357 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.537333 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.538957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.544808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1313/2628] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:20.544808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.549168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1316/2629] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.550852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.552187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effd17b-bb98-42e3-a7e4-60199b9cbfb3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.556997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.557590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.557870 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.558168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] PATH_INFO: `/v3/projects/b983494855c04dd3b82a885146efc360/users/1d998bd0afc543b4957b2a6825792701/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.561005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9ab2-8da2-49bd-be62-d5600c1416d3 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.565945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.566548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.566821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.567092 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.567716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.569290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.573412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b983494855c04dd3b82a885146efc360, user_id=1d998bd0afc543b4957b2a6825792701, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.576323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.579798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1317/2630] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.581109 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.591281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12a2e3-a86f-4c69-ba89-1977c5c835d5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.593046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1314/2631] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:20 2022] PUT /identity/v3/projects/b983494855c04dd3b82a885146efc360/users/1d998bd0afc543b4957b2a6825792701/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:20.593851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.647684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.648337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.648612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.648880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] PATH_INFO: `/v3/projects/46b3c8baa67a431e8d4811e596b9d4f6/users/25dd12eb0ca24cad9f87b0b098176903/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.664712 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cc828-73f8-4694-84cb-4d9d844a02ab admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.665432 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b3c8baa67a431e8d4811e596b9d4f6, user_id=25dd12eb0ca24cad9f87b0b098176903, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.668056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7add1-cd34-4818-b767-00f6c1c8598e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.671373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.671720 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.672075 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.672284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.673085 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.674993 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c52e4-8cbe-47e0-b831-a4b9d4f69ae9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.682621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1318/2632] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:20 2022] PUT /identity/v3/projects/46b3c8baa67a431e8d4811e596b9d4f6/users/25dd12eb0ca24cad9f87b0b098176903/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:20.684062 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.684420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.684885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.686155 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1315/2633] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:20.694275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.694731 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.696430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.716117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] MFA Rules not processed for user `1d998bd0afc543b4957b2a6825792701`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.717344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.724590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] MFA Rules not processed for user `25dd12eb0ca24cad9f87b0b098176903`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.725798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.791413 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1319/2634] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:20.792207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.799159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.802397 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1316/2635] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:20.803217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.831655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:20.866460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f816b-acd9-4f09-9f61-b43177409f1c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.871996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.872659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.872936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.873205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] PATH_INFO: `/v3/projects/955d92d0e73d402ba71a140d18057b72/users/19b47f073cbf4c2192b3b024bc646e57/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.875591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ae356-2330-4b99-a9b4-5112d1f0642f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:20.880363 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:20.880965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.881247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.881520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.882166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.884083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f617-8606-47cc-85e7-3e6891af8839 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.888846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955d92d0e73d402ba71a140d18057b72, user_id=19b47f073cbf4c2192b3b024bc646e57, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:20.891554 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:20.907774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1320/2636] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:20 2022] PUT /identity/v3/projects/955d92d0e73d402ba71a140d18057b72/users/19b47f073cbf4c2192b3b024bc646e57/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:20.909081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:20.917994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1317/2637] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:20.919010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:20.919297 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:20.919576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:20.948916 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] MFA Rules not processed for user `19b47f073cbf4c2192b3b024bc646e57`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:20.950248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:20.978718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083244a-9267-4e05-a50c-3dbaf3af9765 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.013775 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1318/2638] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:21.014625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.036510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.037142 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.037417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.037686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.038365 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.040282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.067947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1321/2639] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:20 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.071917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.077572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af7859-c1b9-4573-a865-a6c71590291a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.090857 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.117905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.134799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823906f-cae6-4f60-995d-304a409369bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.135953 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.136558 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.136838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.137109 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.137728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.139388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.139740 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.140141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.140416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.140734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.141370 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.143939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.162209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1319/2640] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.166601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.175254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1322/2641] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.175254 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.177841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae0510-f504-46d0-bf7e-d884f078f9c0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.233469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a5af1-411c-4697-b573-28b75f17c0a6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.233782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.234421 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.234699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.234971 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.235585 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.238046 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.238766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.239369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.239647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.239918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.240558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.242422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.253748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1323/2642] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.254670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.262414 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1320/2643] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.263400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.264650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b42f6-495c-41fd-9ffa-3e139156ce1e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.270013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.270608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.270880 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.271176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.271830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.273569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79de2b-64b5-4033-beb3-51622670511a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.273730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.280754 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.281770 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.282321 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.282811 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.283995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.286385 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.294174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1324/2644] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/users => generated 300 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.294900 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.301695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1321/2645] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.301695 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.305454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1d0df-5199-4e2b-85b0-e909e9d72061 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.309413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa391-5a68-44f7-9272-4c840686b55c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.310056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.310638 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.310907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.311171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.311799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.313366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.314165 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.315274 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.315555 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.315851 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.316596 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.318209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.324367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1325/2646] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.325126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.328475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1322/2647] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.329164 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.334598 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb60452-0d75-481e-993a-68e7d41d8b7e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.338757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ad414-1d08-49f2-b424-80e00aae8a04 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.339149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.339768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.340105 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.340316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] PATH_INFO: `/v3/projects/f5bc3cc3eeb84dcb8ca8e92cd7845552/users/7040002e2e994ca9a9f48d5649eed2ec/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.343407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.344024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.344303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.344576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] PATH_INFO: `/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f/users/f919526de17c4506adee15425761b668/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.355156 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bc3cc3eeb84dcb8ca8e92cd7845552, user_id=7040002e2e994ca9a9f48d5649eed2ec, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.357916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.364709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0061ea367a8e4d7291631ec0db9c4b9f, user_id=f919526de17c4506adee15425761b668, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.370159 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e504a-0648-4bbc-a915-4db0f77750ca admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.372306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1326/2648] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/f5bc3cc3eeb84dcb8ca8e92cd7845552/users/7040002e2e994ca9a9f48d5649eed2ec/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.373264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.383476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1323/2649] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f/users/f919526de17c4506adee15425761b668/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.387698 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.387988 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.388263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.415132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] MFA Rules not processed for user `7040002e2e994ca9a9f48d5649eed2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:21.416338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:21.421302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.436916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a42f8-e16a-4a7a-a06d-2ff004f61e9d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.482095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1324/2650] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:21.482974 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.488969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.493342 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.494023 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.494425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.494702 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] PATH_INFO: `/v3/projects/bc1d3f50a310473fae63885b2b1696cb/users/d64f11ccbf47412ba910401e3f301a3c/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.509974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1d3f50a310473fae63885b2b1696cb, user_id=d64f11ccbf47412ba910401e3f301a3c, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.512630 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.525562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1327/2651] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/bc1d3f50a310473fae63885b2b1696cb/users/d64f11ccbf47412ba910401e3f301a3c/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.526503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.548850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f9a98-30e0-4430-94fd-36fd4de870df None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.588763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514779-cabd-4e3f-84b3-9da2e5fdf0b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.593512 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.594174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.594453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.594725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.595345 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.597759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.605273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.605884 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.606418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.606699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.607341 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.608918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.623162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1325/2652] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.623162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.628189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1328/2653] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.628951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.633182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c6eea-8a2a-49d4-b4da-a9109f48df98 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.690054 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.690660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.690948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.691175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7163b-e472-4003-9252-b1739c4cbc85 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.691283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.691842 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.693438 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.696088 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.696735 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.697013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.697287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] PATH_INFO: `/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f/users/f919526de17c4506adee15425761b668/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.699311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0061ea367a8e4d7291631ec0db9c4b9f, user_id=f919526de17c4506adee15425761b668, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.701930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.703320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1326/2654] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.703889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.706856 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.713645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b579edd-5e7d-4572-99ba-455006c46a7c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.716028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1329/2655] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f/users/f919526de17c4506adee15425761b668/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.716810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.756973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:21.771987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.772589 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.772868 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.773139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.773779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.775897 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574118-4e02-4e03-83ae-2c29679d1f63 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.780086 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db316d-547f-4088-b688-3bd459758dee admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.785341 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.786010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.786291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.786566 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] PATH_INFO: `/v3/projects/bc1d3f50a310473fae63885b2b1696cb/users/d64f11ccbf47412ba910401e3f301a3c/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.788806 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1d3f50a310473fae63885b2b1696cb, user_id=d64f11ccbf47412ba910401e3f301a3c, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.792009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.797365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1327/2656] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:21.798598 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.798885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.799760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.805741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1330/2657] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/bc1d3f50a310473fae63885b2b1696cb/users/d64f11ccbf47412ba910401e3f301a3c/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.806636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.834880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] MFA Rules not processed for user `f919526de17c4506adee15425761b668`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:21.836098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:21.873777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74734b84-bee9-4666-aadc-027fb0adca15 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.882373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.882985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.883263 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.883896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.884174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.885890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de895fd-39d4-49e4-8bb9-78fd7f7b487d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.897510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1331/2658] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:21.899011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.899325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.899592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.919492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1328/2659] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:21.920443 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.934317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e1b2d-14b0-433d-8d50-2ffba58545f3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:21.936324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] MFA Rules not processed for user `d64f11ccbf47412ba910401e3f301a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:21.937667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:21.939374 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:21.940230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:21.940683 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:21.941113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] PATH_INFO: `/v3/projects/a9295081769243088677d2084d965ca5/users/ac074f356d5a48548a76b18e37a9aeec/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:21.959099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9295081769243088677d2084d965ca5, user_id=ac074f356d5a48548a76b18e37a9aeec, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:21.962417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:21.978615 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1329/2660] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:21 2022] PUT /identity/v3/projects/a9295081769243088677d2084d965ca5/users/ac074f356d5a48548a76b18e37a9aeec/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:21.981998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:21.983965 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:22.019793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1332/2661] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:22.020476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:22.031627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47a29d-99dd-47a1-a5bc-5886981236ed None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.041053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:22.047143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a970-8042-4db3-8392-f68e0e8fa36e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.050753 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.051497 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.051866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.052230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.092560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.093327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.093605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.093874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.094546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.096679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.100890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:22.109590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1333/2662] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:22.109590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:22.109590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:22.118901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.120282 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.121097 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935c47a-97dc-4078-903e-8f47162eeb54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.124713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.125291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.125564 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.125832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.129849 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1330/2663] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:22.130704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:22.140941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5e0c-151a-43b4-b69a-e5cc0687cd27 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.146495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.147149 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.147550 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.147828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] PATH_INFO: `/v3/projects/a9295081769243088677d2084d965ca5/users/ac074f356d5a48548a76b18e37a9aeec/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.150008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9295081769243088677d2084d965ca5, user_id=ac074f356d5a48548a76b18e37a9aeec, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.152652 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913332-6e77-4a12-b093-b15c0aeda500 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.163994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1331/2664] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:22 2022] PUT /identity/v3/projects/a9295081769243088677d2084d965ca5/users/ac074f356d5a48548a76b18e37a9aeec/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:22.175500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.175790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.176069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.204663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] MFA Rules not processed for user `ac074f356d5a48548a76b18e37a9aeec`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:22.206552 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:22.210983 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.212454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.223748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1334/2665] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:22.246774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:22.255532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bc522-b0c3-4627-829b-410b5623f959 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.290056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1332/2666] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:22.311181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.311795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.312072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.312339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.324147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:22.334095 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606db968-b591-4bde-8cc6-576c11fdb091 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:22.337656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:22.338280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:22.338554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:22.338818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:22.348432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.351251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.362459 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1333/2667] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:22.370751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=100 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:22.373573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:22.375669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:22.386452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1335/2668] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:23.013133 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:23.031287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:23.040425 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08585bb5-d380-49d4-a596-b89b699bd663 service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:23.044190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:23.044783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.045052 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.045313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.084047 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae642-54e9-40a6-9db7-985ad57ef0c4 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:23.088807 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:23.089435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.089718 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.090015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] PATH_INFO: `/v3/users/19b47f073cbf4c2192b3b024bc646e57` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.091204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b47f073cbf4c2192b3b024bc646e57)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:23.093144 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:23.113740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:23.115540 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4390-6ecb-4d96-930b-cd262ed941d1 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:23.128301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1336/2669] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:23.148645 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:23.151553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b47f073cbf4c2192b3b024bc646e57'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.152294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b47f073cbf4c2192b3b024bc646e57'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.170514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b47f073cbf4c2192b3b024bc646e57'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.171458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b47f073cbf4c2192b3b024bc646e57'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.183389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b47f073cbf4c2192b3b024bc646e57'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.200364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1334/2670] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:23 2022] DELETE /identity/v3/users/19b47f073cbf4c2192b3b024bc646e57 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:23.202775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.203589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.203589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.225765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:23.227001 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:23.295970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1337/2671] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:23.306637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:23.308064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:23.375846 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60b711-36a0-421e-b50b-e6bee73bc677 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:23.390801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:23.391345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.391626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.391903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.403043 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:23.404485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:23.422023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1335/2672] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:23.692025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:23.693494 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:23.706977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b58a5c-844f-48ac-91d3-0eff7471c17a None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:23.712171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:23.712826 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.713128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.713401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] PATH_INFO: `/v3/projects/955d92d0e73d402ba71a140d18057b72` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.715591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=955d92d0e73d402ba71a140d18057b72)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:23.717510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:23.770301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955d92d0e73d402ba71a140d18057b72', 'request_id': 'req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.776299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955d92d0e73d402ba71a140d18057b72', 'request_id': 'req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.787379 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955d92d0e73d402ba71a140d18057b72', 'request_id': 'req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.799424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] The token cache is being invalidate because project 955d92d0e73d402ba71a140d18057b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:23.799717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.800369 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.802111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1338/2673] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:23 2022] DELETE /identity/v3/projects/955d92d0e73d402ba71a140d18057b72 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:23.805790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:23.816176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb572aa5-900c-47b7-8755-828566e5bd5a service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:23.877575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:23.878238 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:23.878515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:23.878780 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] PATH_INFO: `/v3/users/d64f11ccbf47412ba910401e3f301a3c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:23.879882 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64f11ccbf47412ba910401e3f301a3c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:23.881786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:23.932011 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64f11ccbf47412ba910401e3f301a3c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.932733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64f11ccbf47412ba910401e3f301a3c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.944938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64f11ccbf47412ba910401e3f301a3c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.945605 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64f11ccbf47412ba910401e3f301a3c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.953400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:23.959542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-770c339a-4177-4f38-acf1-80e4476b638c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64f11ccbf47412ba910401e3f301a3c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:23.974226 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1336/2674] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:23 2022] DELETE /identity/v3/users/d64f11ccbf47412ba910401e3f301a3c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:24.249739 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.251315 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:24.265785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf5ee-6cf5-48e3-bdac-d5265ca2aabf admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.279874 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:24.335659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.336595 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.337033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.337492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] PATH_INFO: `/v3/projects/bc1d3f50a310473fae63885b2b1696cb` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.339445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1d3f50a310473fae63885b2b1696cb)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.341534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.401460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1d3f50a310473fae63885b2b1696cb', 'request_id': 'req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:24.408392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1d3f50a310473fae63885b2b1696cb', 'request_id': 'req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:24.417251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1d3f50a310473fae63885b2b1696cb', 'request_id': 'req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:24.429538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] The token cache is being invalidate because project bc1d3f50a310473fae63885b2b1696cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:24.429828 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:24.430510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-4f0adfad-6eb5-4d9d-8d07-26649fa26f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:24.432179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1339/2675] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:24 2022] DELETE /identity/v3/projects/bc1d3f50a310473fae63885b2b1696cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:24.445302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.445850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.445850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.471927 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:24.473138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:24.552154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1337/2676] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:24.561107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.561391 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.561662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.581181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:24.582415 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:24.590546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1340/2677] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:24.594771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.604857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42620e6-d00e-44d1-91c8-4cbf79891e2e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.609913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.610554 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.610831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.611267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.612715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:24.613063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.614813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.627900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1338/2678] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:34:24.632158 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.641396 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798e7d9-ddeb-4ed3-a22c-15a1df469fdb None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.647017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.647985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.648438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.648687 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.649327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.651265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.679930 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1341/2679] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:24 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:24.684138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.694024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65861201-d331-46f8-9f38-3fcaea6a8325 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.748992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.749504 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.749776 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.750097 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.750716 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.752659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.773757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1339/2680] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:24 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:24.778469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.789588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38859b82-2e73-4dab-85cf-58891234136a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.794388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.794977 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.795255 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.795525 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.796155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.797752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.808273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1342/2681] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:24.812210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.822526 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b58b-ccba-41cc-9c31-bca05351d7c7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.827853 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.828632 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.828992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.829280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.830080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.831814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f03d15-2a60-48c6-afab-c645cb68b34e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.842419 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1340/2682] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:24.847288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:24.857476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0dfa-ed56-4633-89d3-18a760b5bc5d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:24.862844 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:24.863489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.863768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.864068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] PATH_INFO: `/v3/projects/d7237eac201a4508b30a4c16a1d88676/users/ef88d5a7d0cc49cd80e3cab4d5284ac9/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.878885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7237eac201a4508b30a4c16a1d88676, user_id=ef88d5a7d0cc49cd80e3cab4d5284ac9, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:24.881526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:24.894307 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1343/2683] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:24 2022] PUT /identity/v3/projects/d7237eac201a4508b30a4c16a1d88676/users/ef88d5a7d0cc49cd80e3cab4d5284ac9/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:24.906454 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:24.906743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:24.907048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:24.934843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] MFA Rules not processed for user `ef88d5a7d0cc49cd80e3cab4d5284ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:24.936074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:24.975150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.001187 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1341/2684] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:25.012614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.014359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.029268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.030778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.061059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.073648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e77ee1-525f-43c2-a737-59157ab778f8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.077666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.078303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.078578 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.078847 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.088072 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.089511 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.099132 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc0c75-6f53-48be-9979-510fcd1f6381 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.099291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1344/2685] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:25.103815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.104441 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.104812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.104973 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] PATH_INFO: `/v3/users/25dd12eb0ca24cad9f87b0b098176903` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.106125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25dd12eb0ca24cad9f87b0b098176903)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.108131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.120189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.130704 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c1f5-c405-4f67-b924-43a7e0a1f63d service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.135694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.136330 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.136633 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.136901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] PATH_INFO: `/v3/users/ef88d5a7d0cc49cd80e3cab4d5284ac9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.138076 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef88d5a7d0cc49cd80e3cab4d5284ac9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.140100 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.161246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25dd12eb0ca24cad9f87b0b098176903'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.161913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25dd12eb0ca24cad9f87b0b098176903'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.175038 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25dd12eb0ca24cad9f87b0b098176903'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.175812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25dd12eb0ca24cad9f87b0b098176903'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.183600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-896d71ac-f2ac-4a8d-8bd3-ce813536203d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25dd12eb0ca24cad9f87b0b098176903'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.189896 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef88d5a7d0cc49cd80e3cab4d5284ac9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.190616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef88d5a7d0cc49cd80e3cab4d5284ac9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.196246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1342/2686] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:25 2022] DELETE /identity/v3/users/25dd12eb0ca24cad9f87b0b098176903 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:25.200611 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.200979 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.201327 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.203164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef88d5a7d0cc49cd80e3cab4d5284ac9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.211925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef88d5a7d0cc49cd80e3cab4d5284ac9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.219693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-41255682-a5be-41da-b52d-70bc7658539c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef88d5a7d0cc49cd80e3cab4d5284ac9'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:25.222153 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:25.223432 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.227078 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1345/2687] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:25 2022] DELETE /identity/v3/users/ef88d5a7d0cc49cd80e3cab4d5284ac9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:25.231381 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.231698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.231972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.251136 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:25.252442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.275015 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.286127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1343/2688] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:25.294856 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.296214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.317336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1346/2689] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:25.326558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.327978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.359939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe080cd-1a64-4e43-837d-fa6e18e5ffc6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.386339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13a5c2-bf13-4906-830d-f5e6af351839 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.390096 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.390695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.390966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.391232 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.400719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.402193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.410763 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.411369 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.411821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1347/2690] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:25.411968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.411968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.421556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.423037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.432889 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1344/2691] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:25.912966 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.914665 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.922960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:25.930935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a76ba-3933-4951-9602-e9c30ba1d091 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:25.936873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:25.938035 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:25.938416 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:25.938832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:25.939181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:25.939605 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] PATH_INFO: `/v3/projects/d7237eac201a4508b30a4c16a1d88676` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:25.941713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7237eac201a4508b30a4c16a1d88676)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:25.943705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:25.983248 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25543a-6888-4924-990b-141c1d3af799 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.001353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7237eac201a4508b30a4c16a1d88676', 'request_id': 'req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.009743 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7237eac201a4508b30a4c16a1d88676', 'request_id': 'req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.030684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7237eac201a4508b30a4c16a1d88676', 'request_id': 'req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.048572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] The token cache is being invalidate because project d7237eac201a4508b30a4c16a1d88676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:26.049012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.050296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-12f4453e-3554-4bdb-8953-c6f6c2ab01cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.055480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1348/2692] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:25 2022] DELETE /identity/v3/projects/d7237eac201a4508b30a4c16a1d88676 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:26.057026 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db926f-46d5-4827-a05c-1519aec7c5c2 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.057388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db926f-46d5-4827-a05c-1519aec7c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.057671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db926f-46d5-4827-a05c-1519aec7c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.081935 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c2db926f-46d5-4827-a05c-1519aec7c5c2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:26.083277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c2db926f-46d5-4827-a05c-1519aec7c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.099970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.100638 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.100914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.101191 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] PATH_INFO: `/v3/projects/46b3c8baa67a431e8d4811e596b9d4f6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.102356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b3c8baa67a431e8d4811e596b9d4f6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.104316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.157437 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1349/2693] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:26.159067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b3c8baa67a431e8d4811e596b9d4f6', 'request_id': 'req-73339519-7e69-4db7-8489-90d0b61ead01'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.165753 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.165954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b3c8baa67a431e8d4811e596b9d4f6', 'request_id': 'req-73339519-7e69-4db7-8489-90d0b61ead01'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.166694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.166694 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.170051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:26.177283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b3c8baa67a431e8d4811e596b9d4f6', 'request_id': 'req-73339519-7e69-4db7-8489-90d0b61ead01'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.194278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:26.195782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.196528 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] The token cache is being invalidate because project 46b3c8baa67a431e8d4811e596b9d4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:26.197285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.198259 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.200575 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1345/2694] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:25 2022] DELETE /identity/v3/projects/46b3c8baa67a431e8d4811e596b9d4f6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:26.204828 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.207590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.271864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1350/2695] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:26.272905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.277160 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339519-7e69-4db7-8489-90d0b61ead01 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.282992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e134-f2cf-4a78-b1ab-d166b894db94 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.283871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.284662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.284940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.285208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] PATH_INFO: `/v3/users/f919526de17c4506adee15425761b668` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.286364 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f919526de17c4506adee15425761b668)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.288330 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.290079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.291137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.291603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.292028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.292829 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:26.293410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.295500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.312676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1351/2696] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:26.316859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.329814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a448f-bf0f-4b14-b9aa-17e19937bb33 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.336590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.337373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.337653 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.337925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.338568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.340528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.354686 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f919526de17c4506adee15425761b668'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.355320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f919526de17c4506adee15425761b668'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.358673 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:26.378428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f919526de17c4506adee15425761b668'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.379125 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f919526de17c4506adee15425761b668'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.385477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1352/2697] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:26.386766 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.389349 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.392326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f919526de17c4506adee15425761b668'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.414452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1346/2698] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:26 2022] DELETE /identity/v3/users/f919526de17c4506adee15425761b668 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:26.473285 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc0961-acde-48f8-bd2a-fe8d212e1240 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.542149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.543234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.543503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.543763 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.544374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.546302 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.568667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1353/2699] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:26.573182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.586058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4187f16-a517-48f4-b7a2-9cc1d97802ef admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.591798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.592534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.592819 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.593088 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.593867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.595492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.606633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1347/2700] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:26.610519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.620957 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ce5c-76e9-4658-bc78-8872bc26f64b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.625815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.626460 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.626736 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.627041 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.627683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.629288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5fc54-0224-4caf-8c96-e0b4982c2bf6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.639454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1354/2701] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:26.643964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.653919 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8499f-e8cb-420d-9cd5-2d4ccd9ed3dd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.659541 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.660337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.660614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.660886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] PATH_INFO: `/v3/projects/2f7df2edf05f4cb597d67dfdea4f94e2/users/9dde4c5c4ce24c1a8b70334cd97c2d7f/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.678992 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7df2edf05f4cb597d67dfdea4f94e2, user_id=9dde4c5c4ce24c1a8b70334cd97c2d7f, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.681670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.698520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1348/2702] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:26 2022] PUT /identity/v3/projects/2f7df2edf05f4cb597d67dfdea4f94e2/users/9dde4c5c4ce24c1a8b70334cd97c2d7f/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:26.703812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.704102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.704383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.716113 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.719428 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.729925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:26.731363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.768353 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:26.817941 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404438-9522-488c-a085-66b46f0fe7ab admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.824117 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.824758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.825039 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.825314 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] PATH_INFO: `/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.826606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0061ea367a8e4d7291631ec0db9c4b9f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:26.826803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1355/2703] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:26.829022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:26.839090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:26.840648 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.879161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:26.902012 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0061ea367a8e4d7291631ec0db9c4b9f', 'request_id': 'req-dab4d641-ad88-4899-8b2c-bdaf5fd37280'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.912626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0061ea367a8e4d7291631ec0db9c4b9f', 'request_id': 'req-dab4d641-ad88-4899-8b2c-bdaf5fd37280'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.923958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0061ea367a8e4d7291631ec0db9c4b9f', 'request_id': 'req-dab4d641-ad88-4899-8b2c-bdaf5fd37280'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.938023 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] The token cache is being invalidate because project 0061ea367a8e4d7291631ec0db9c4b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:26.938663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.939008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dab4d641-ad88-4899-8b2c-bdaf5fd37280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:26.941200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1349/2704] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:26 2022] DELETE /identity/v3/projects/0061ea367a8e4d7291631ec0db9c4b9f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:26.942265 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78ec51-f058-4328-99c8-1e9a9c60a349 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:26.948390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1be2-fe1a-43b2-b49c-745c1cda412e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.948823 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1be2-fe1a-43b2-b49c-745c1cda412e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:26.949208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1be2-fe1a-43b2-b49c-745c1cda412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:26.969861 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-eefb1be2-fe1a-43b2-b49c-745c1cda412e None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:26.971112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eefb1be2-fe1a-43b2-b49c-745c1cda412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:26.998985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:26.999628 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:26.999912 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.000184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.002421 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.030514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1350/2705] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:27.038090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.038378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.038656 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.057465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:27.058700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.067740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.069987 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1351/2706] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:27.072591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.072723 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.082365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab24d-439a-4279-91c1-d8962e32709a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.083816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1356/2707] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:27.088800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.089243 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.089547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.089818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.090507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:27.090806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.092867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.105101 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1352/2708] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:34:27.109707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.121631 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ae34-4ded-406a-9356-7ad6807db036 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.126706 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.127926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.128207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.128506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.129123 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.131063 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.166113 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1357/2709] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:27.168027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.180161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38683d78-f52a-4498-bec5-4cdfdc054ae3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.236298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:27.256139 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.256887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.257167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.257436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.258130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.260161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.288521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1353/2710] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:27.292553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.303017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.303170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3872f0-c686-4b08-a2cf-e6d5f3dafe79 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.304898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.307827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.308419 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.308707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.308950 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.309579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.311201 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.322693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1358/2711] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:27.326528 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.340671 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd5c52-99c8-44be-aa08-16e1b84df0b9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.347858 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.349679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.350006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.350279 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.351334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.353269 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.367973 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1359/2712] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:34:27.372080 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.378474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73555cf-54d4-4703-bcda-e08d9cce69b7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.383502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d480d-ba54-4acd-9399-745400df14d4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.383880 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.384495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.384805 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.385040 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.387277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.388446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.389090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.389368 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.389654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] PATH_INFO: `/v3/projects/50ee36ed4e7c4a928bad223cc5217457/users/83b4c699ea6a476585ff47f8cdd69a71/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.406382 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ee36ed4e7c4a928bad223cc5217457, user_id=83b4c699ea6a476585ff47f8cdd69a71, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.409676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664b0c4-9f1b-426c-b775-4f6635d5cef6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.441319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1360/2713] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:27 2022] PUT /identity/v3/projects/50ee36ed4e7c4a928bad223cc5217457/users/83b4c699ea6a476585ff47f8cdd69a71/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:27.444717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.445004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.445275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.480725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] MFA Rules not processed for user `83b4c699ea6a476585ff47f8cdd69a71`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:27.481982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.486221 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:27.487677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.489056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.502049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1354/2714] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:27.563244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1361/2715] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:27.568350 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.582244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a85219-4e4a-4bee-bd1e-2f96d30211b6 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.652290 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.652906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.653195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.653594 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.654279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.656208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9c88-5023-447d-bf2a-52e5a47dbcf9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.694637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.696277 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1355/2716] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:27.706670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5361-0741-4de7-bce2-9725d02154fe None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.780868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.781505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.781916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.782230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.783608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.786919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.806284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.806649 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.806912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.821837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1362/2717] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:27.825927 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.842042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8cb74-c9b8-4951-907e-52b230658bf4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.842195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:27.847008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] MFA Rules not processed for user `9dde4c5c4ce24c1a8b70334cd97c2d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:27.849279 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:27.850124 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.850717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.850996 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.851264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.851910 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.854548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.869557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1363/2718] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:27.873565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.885033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d88db-ea66-4f13-94b9-bee78bf4963f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:27.890759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:27.891622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:27.891622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:27.891936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] PATH_INFO: `/v3/projects/5621f8375ac7463bace8b8df9678a5f2/users/8ba844e45a014942bf14b753ef24909a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:27.916338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5621f8375ac7463bace8b8df9678a5f2, user_id=8ba844e45a014942bf14b753ef24909a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:27.920154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:27.945121 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1364/2719] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:27 2022] PUT /identity/v3/projects/5621f8375ac7463bace8b8df9678a5f2/users/8ba844e45a014942bf14b753ef24909a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:27.950651 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.951298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1356/2720] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:27.962525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:27.964312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:28.029412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afe40d-31e0-4291-8713-5f82d5292607 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:28.036363 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:28.037409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.038339 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.038646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.039350 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:28.040934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:28.046527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:28.058229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1365/2721] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:28.062519 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:28.078521 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abeb41-d8af-417c-a8e7-32008c893246 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:28.081852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11102b-2743-4f65-b8b3-06ed63555657 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:28.090530 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:28.097056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.097597 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.098915 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] PATH_INFO: `/v3/projects/5621f8375ac7463bace8b8df9678a5f2/users/8ba844e45a014942bf14b753ef24909a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.102216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5621f8375ac7463bace8b8df9678a5f2, user_id=8ba844e45a014942bf14b753ef24909a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:28.105207 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83f294-0957-483a-9332-c3b743eb2835 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:28.123443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1366/2722] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:28 2022] PUT /identity/v3/projects/5621f8375ac7463bace8b8df9678a5f2/users/8ba844e45a014942bf14b753ef24909a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:28.148776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.149331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.149803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.184759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:28.185524 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.185700 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.186281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.220181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] MFA Rules not processed for user `8ba844e45a014942bf14b753ef24909a`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:28.222401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:28.275208 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:28.276664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:28.287255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1357/2723] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:28.323526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1367/2724] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:28.393684 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:28.403303 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949e630-6b46-4d50-900c-8e8b1a30899e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:28.419033 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:28.462380 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:28.462997 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.463273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.463573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.474734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:28.476458 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef87a71-6824-4644-8673-213ed91c598a service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:28.489887 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1358/2725] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:28.691560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:28.763058 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1a0d0-2f97-4aa3-9cd2-5a37c336a73c None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:28.768556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:28.769366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.769646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.769917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] PATH_INFO: `/v3/users/83b4c699ea6a476585ff47f8cdd69a71` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.771300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b4c699ea6a476585ff47f8cdd69a71)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:28.773244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:28.821104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b4c699ea6a476585ff47f8cdd69a71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:28.821759 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b4c699ea6a476585ff47f8cdd69a71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:28.834135 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b4c699ea6a476585ff47f8cdd69a71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:28.837755 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:28.842079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b4c699ea6a476585ff47f8cdd69a71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:28.851377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b4c699ea6a476585ff47f8cdd69a71'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:28.857163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1368/2726] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:28 2022] DELETE /identity/v3/users/83b4c699ea6a476585ff47f8cdd69a71 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:28.861670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:28.861998 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:28.862281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:28.880817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:28.882034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:28.941569 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1359/2727] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:28.951297 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:28.952752 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:29.011238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeb6cb-b472-4804-bd4d-4b95bf3734b6 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:29.014902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:29.015506 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:29.015781 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:29.016048 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:29.025311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:29.026780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:29.036601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1369/2728] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:29.309728 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:29.312091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:29.325777 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e883f-c79d-40ef-ba32-5819edfb0166 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:29.331257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:29.331938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:29.332298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:29.332544 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] PATH_INFO: `/v3/projects/50ee36ed4e7c4a928bad223cc5217457` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:29.333580 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ee36ed4e7c4a928bad223cc5217457)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:29.335539 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:29.389032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ee36ed4e7c4a928bad223cc5217457', 'request_id': 'req-52fd1689-aef2-4e86-a62e-50203563fba5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.395107 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ee36ed4e7c4a928bad223cc5217457', 'request_id': 'req-52fd1689-aef2-4e86-a62e-50203563fba5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.403134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ee36ed4e7c4a928bad223cc5217457', 'request_id': 'req-52fd1689-aef2-4e86-a62e-50203563fba5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.414850 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] The token cache is being invalidate because project 50ee36ed4e7c4a928bad223cc5217457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:29.415055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.419915 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52fd1689-aef2-4e86-a62e-50203563fba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.421633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1360/2729] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:29 2022] DELETE /identity/v3/projects/50ee36ed4e7c4a928bad223cc5217457 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:29.425913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:29.435614 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fed00d-18fe-4075-bec5-048e9712e39d service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:29.491210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:29.491762 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:29.492301 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:29.492572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] PATH_INFO: `/v3/users/8ba844e45a014942bf14b753ef24909a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:29.493699 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba844e45a014942bf14b753ef24909a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:29.495693 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:29.540278 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba844e45a014942bf14b753ef24909a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.540920 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba844e45a014942bf14b753ef24909a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.553189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba844e45a014942bf14b753ef24909a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.560362 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba844e45a014942bf14b753ef24909a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.567770 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba844e45a014942bf14b753ef24909a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:29.573558 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1370/2730] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:29 2022] DELETE /identity/v3/users/8ba844e45a014942bf14b753ef24909a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:29.821779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:29.822093 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:29.822358 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:29.846056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] MFA Rules not processed for user `9dde4c5c4ce24c1a8b70334cd97c2d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:29.848002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:29.871610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:29.873107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:29.885218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:29.894348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:29.960756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef1ce-87bc-4a02-be1b-8b60f2027aeb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:29.965689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:29.966495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:29.966823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:29.967176 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] PATH_INFO: `/v3/projects/5621f8375ac7463bace8b8df9678a5f2` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:29.968632 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5621f8375ac7463bace8b8df9678a5f2)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:29.971157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.027149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5621f8375ac7463bace8b8df9678a5f2', 'request_id': 'req-1e0e1664-7d53-404f-820f-800df902369e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.034178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5621f8375ac7463bace8b8df9678a5f2', 'request_id': 'req-1e0e1664-7d53-404f-820f-800df902369e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.043805 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5621f8375ac7463bace8b8df9678a5f2', 'request_id': 'req-1e0e1664-7d53-404f-820f-800df902369e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.055843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] The token cache is being invalidate because project 5621f8375ac7463bace8b8df9678a5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:30.056144 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.056786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-1e0e1664-7d53-404f-820f-800df902369e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.058493 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1371/2731] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:29 2022] DELETE /identity/v3/projects/5621f8375ac7463bace8b8df9678a5f2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:30.067535 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f466-c788-4f73-a224-4d5dce3c888d None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.067721 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1361/2732] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:30.067839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f466-c788-4f73-a224-4d5dce3c888d None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.067839 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f466-c788-4f73-a224-4d5dce3c888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.091037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d7e4f466-c788-4f73-a224-4d5dce3c888d None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:30.092446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d7e4f466-c788-4f73-a224-4d5dce3c888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.100945 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.102659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.121563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58edfd8-430c-44b5-ad8c-5fcdaf324d3f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.167789 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1372/2733] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:30.176053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.176300 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.176551 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.186506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.187247 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.187597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.187957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] PATH_INFO: `/v3/users/1d998bd0afc543b4957b2a6825792701` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.189201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d998bd0afc543b4957b2a6825792701)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.191948 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.196600 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:30.198009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.205933 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1373/2734] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:30.211827 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.221334 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488cfa9-be2d-4987-9088-e0745b81e1c1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.227557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.228488 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.229323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.229323 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.229955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:30.230389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.232190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.248735 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d998bd0afc543b4957b2a6825792701'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.250118 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1374/2735] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:30.250246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d998bd0afc543b4957b2a6825792701'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.254257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.264739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d998bd0afc543b4957b2a6825792701'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.265514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d998bd0afc543b4957b2a6825792701'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.265815 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f3428-69dd-4165-bc6c-56446480c207 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.271726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.272489 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.273044 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.273208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.274074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-12b39295-1368-46b8-ac15-7a8d3592b122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d998bd0afc543b4957b2a6825792701'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:30.274202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.276627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.287391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1362/2736] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:30 2022] DELETE /identity/v3/users/1d998bd0afc543b4957b2a6825792701 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:30.291514 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.291650 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.292021 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.304861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:30.312848 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:30.314975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.319707 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1375/2737] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:30.320717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.322990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.385316 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1363/2738] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:30.396388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.397871 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.404425 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:30.422542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbec9-645b-4c0a-9834-c9bcad087a06 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.431452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.432081 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.432865 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.433310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.434322 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.436451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.462750 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1376/2739] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:30.470188 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.477162 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0c9cd-55e6-47e3-8102-2d9fc90cdc67 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.485423 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.486081 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.486894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.487166 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.489375 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8080553-c313-4a76-a1d6-c6e33259a711 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.494974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.495798 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.496376 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.496672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.497331 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.498970 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.499563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.501170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.515955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1377/2740] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:30.516329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1364/2741] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 07:34:30.516986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.528038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994d11-a29f-4c66-8206-b3880da42941 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.532810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.534147 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.534426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.534686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.535327 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.536932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd18b92-c89d-4ee5-85b7-4a38106714a5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.549666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1378/2742] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:34:30.553535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.564703 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424921f3-83bc-48e3-90cf-e63ea1b3a6f0 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.570670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.571559 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.572163 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.572536 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] PATH_INFO: `/v3/projects/eda53424734e4571ba7ea8cd68ef34d4/users/3a6786145e8a48239f746d5d2ea16571/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.594806 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda53424734e4571ba7ea8cd68ef34d4, user_id=3a6786145e8a48239f746d5d2ea16571, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.598236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.615952 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1365/2743] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:30 2022] PUT /identity/v3/projects/eda53424734e4571ba7ea8cd68ef34d4/users/3a6786145e8a48239f746d5d2ea16571/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:30.627457 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.627646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.627929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.659295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] MFA Rules not processed for user `3a6786145e8a48239f746d5d2ea16571`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:30.660429 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.767038 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1379/2744] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:30.781758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.784583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.877387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:30.879066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:30.906013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032c9cc-1ee3-4b27-9a81-e0ea5131b65a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:30.912812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1660172c4c324dfab2365443884f6784', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:30.913527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:30.913932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:30.914405 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:30.933099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:30.936157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:30.949628 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1366/2745] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:30.998238 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:31.016990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297008f3-016d-40ed-8f4c-f2663cc344b1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:31.022908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:31.024066 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:31.024455 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:31.024784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] PATH_INFO: `/v3/projects/b983494855c04dd3b82a885146efc360` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:31.026152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b983494855c04dd3b82a885146efc360)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:31.028180 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:31.096534 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b983494855c04dd3b82a885146efc360', 'request_id': 'req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.103669 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b983494855c04dd3b82a885146efc360', 'request_id': 'req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.115917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b983494855c04dd3b82a885146efc360', 'request_id': 'req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.131723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] The token cache is being invalidate because project b983494855c04dd3b82a885146efc360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:31.132012 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.132816 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.134553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1380/2746] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:30 2022] DELETE /identity/v3/projects/b983494855c04dd3b82a885146efc360 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:31.139490 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:31.152246 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6c668-8de6-49ee-a66b-b77279c6616c service glance] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:31.238253 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:31.239437 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:31.239905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:31.240511 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] PATH_INFO: `/v3/users/7040002e2e994ca9a9f48d5649eed2ec` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:31.242474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7040002e2e994ca9a9f48d5649eed2ec)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:31.245788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:31.287818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:31.318525 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7040002e2e994ca9a9f48d5649eed2ec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.319994 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7040002e2e994ca9a9f48d5649eed2ec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.336912 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7040002e2e994ca9a9f48d5649eed2ec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.338016 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7040002e2e994ca9a9f48d5649eed2ec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.347147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7040002e2e994ca9a9f48d5649eed2ec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.366009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1367/2747] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:31 2022] DELETE /identity/v3/users/7040002e2e994ca9a9f48d5649eed2ec => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:31.771562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:31.773247 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:31.789160 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a94b4-852d-46bc-a0a0-cac17dc4d6d4 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:31.861374 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:31.862356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:31.862985 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:31.863686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] PATH_INFO: `/v3/projects/f5bc3cc3eeb84dcb8ca8e92cd7845552` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:31.871477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bc3cc3eeb84dcb8ca8e92cd7845552)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:31.873768 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:31.950670 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bc3cc3eeb84dcb8ca8e92cd7845552', 'request_id': 'req-d811ca48-e047-43a5-8107-69114ff442b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.957574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bc3cc3eeb84dcb8ca8e92cd7845552', 'request_id': 'req-d811ca48-e047-43a5-8107-69114ff442b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:31.979824 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bc3cc3eeb84dcb8ca8e92cd7845552', 'request_id': 'req-d811ca48-e047-43a5-8107-69114ff442b1'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.000059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] The token cache is being invalidate because project f5bc3cc3eeb84dcb8ca8e92cd7845552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:32.001202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.006855 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.010410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1381/2748] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:31 2022] DELETE /identity/v3/projects/f5bc3cc3eeb84dcb8ca8e92cd7845552 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:32.014576 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:32.016195 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:32.041452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffe84b-437b-4057-a021-cd0965aa6d35 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:32.150664 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:32.151308 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:32.151588 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:32.151859 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] PATH_INFO: `/v3/users/ac074f356d5a48548a76b18e37a9aeec` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:32.152982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac074f356d5a48548a76b18e37a9aeec)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:32.155189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:32.228118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac074f356d5a48548a76b18e37a9aeec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.228798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac074f356d5a48548a76b18e37a9aeec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.246900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac074f356d5a48548a76b18e37a9aeec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.248056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac074f356d5a48548a76b18e37a9aeec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.261779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49fd0a8c-0026-44fe-b3aa-884c6755c9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac074f356d5a48548a76b18e37a9aeec'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:32.277388 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1368/2749] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:32 2022] DELETE /identity/v3/users/ac074f356d5a48548a76b18e37a9aeec => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:32.871868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:32.873141 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:32.890929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811ca48-e047-43a5-8107-69114ff442b1 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:32.926399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:32.995219 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:32.995863 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:32.996143 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:32.996418 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] PATH_INFO: `/v3/projects/a9295081769243088677d2084d965ca5` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:32.997723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9295081769243088677d2084d965ca5)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:32.999952 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.067990 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9295081769243088677d2084d965ca5', 'request_id': 'req-2c712253-2ee9-42c6-bb3f-9c722cfc878d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:33.075408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9295081769243088677d2084d965ca5', 'request_id': 'req-2c712253-2ee9-42c6-bb3f-9c722cfc878d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:33.088468 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9295081769243088677d2084d965ca5', 'request_id': 'req-2c712253-2ee9-42c6-bb3f-9c722cfc878d'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:33.110212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] The token cache is being invalidate because project a9295081769243088677d2084d965ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:33.111606 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:33.113049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-2c712253-2ee9-42c6-bb3f-9c722cfc878d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:33.115711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1382/2750] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:32 2022] DELETE /identity/v3/projects/a9295081769243088677d2084d965ca5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:33.121715 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.122202 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.122403 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.154563 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:33.155782 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:33.185102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:33.250294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1369/2751] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:33.259162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.259475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.259718 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.305646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:33.307471 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:33.328053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1383/2752] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:33.332142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.345637 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b485d-37e4-42b0-a159-2c7b32f039d2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.351400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.352060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.352326 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.352590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.353240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:33.354030 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.355386 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.378879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1370/2753] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:33.382992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.392556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f18b67-6651-44b7-971d-d8c332dd44a3 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.399976 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.400843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.401189 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.401555 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.402426 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.404940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.440319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1384/2754] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:33.444102 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.457827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a363-2365-4f5b-884b-a8bb70d9471e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.530182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.530800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.531078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.531348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.532675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.534658 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.564829 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1371/2755] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/users => generated 305 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:33.569117 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.580373 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790c35-2935-4fd0-b61a-9ea85f37e96b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.585253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.585894 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.586200 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.586698 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.587102 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.589042 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.603082 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1385/2756] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:33.606917 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.619384 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46149e8-7610-4c81-8cc5-f296d4c037c7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.625298 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.626108 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.626453 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.626918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.627448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.629995 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6617c-b60c-4398-9797-987f8c3f4dad admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.642084 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1372/2757] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:33.646377 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.658539 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea600e3-a239-420a-a41e-b6d1e0ab2a5b admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.664737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.665570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.665947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.666344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] PATH_INFO: `/v3/projects/dae459c7acde4662a3a74d4d03376e75/users/426bc978debf4e67b589506fc149344e/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.686310 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae459c7acde4662a3a74d4d03376e75, user_id=426bc978debf4e67b589506fc149344e, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.688998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.711537 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1386/2758] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:33 2022] PUT /identity/v3/projects/dae459c7acde4662a3a74d4d03376e75/users/426bc978debf4e67b589506fc149344e/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:33.718838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.719134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.719407 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.767839 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] MFA Rules not processed for user `426bc978debf4e67b589506fc149344e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:33.769268 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:33.855586 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1373/2759] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:33.860016 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:33.914298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:33.939408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313d891-75ba-4bb8-bc4f-aab1c235b3e0 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:33.944713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:33.945335 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:33.945625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:33.945902 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:33.946726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:33.948786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:33.989161 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1387/2760] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:33.993413 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.004547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca5e9-2027-4cb3-933c-9582d7f594a7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.027433 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:34.080904 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.082024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.082024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.082275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.082835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.087935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.113553 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1374/2761] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:33 2022] POST /identity/v3/users => generated 310 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:34.117924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.135832 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a9a30-8a35-4a9b-8862-097570a49beb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.145625 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.146408 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.146761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.147570 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.147895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.149734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.166353 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1388/2762] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:34.168556 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.231480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b72d2-79af-40d1-b833-cc0940d943d6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.248408 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.249099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.249381 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.249662 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] PATH_INFO: `/v3/projects/8e5c511aaa624e768ce427de0f6c054c/users/0fd82bedeb884746bf05e529c462c728/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.278009 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c511aaa624e768ce427de0f6c054c, user_id=0fd82bedeb884746bf05e529c462c728, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.281032 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.297484 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1375/2763] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:34 2022] PUT /identity/v3/projects/8e5c511aaa624e768ce427de0f6c054c/users/0fd82bedeb884746bf05e529c462c728/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:34.301218 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.313562 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48682e59-d1e0-48e3-bd37-0edf34e8f1c5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.402999 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.408013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.408013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.408013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.408013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.408013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a94d98-f65a-4ce9-84df-5e1cf8a0de71 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.420240 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1389/2764] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:34.424209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.436885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64caee-787d-48d6-a7f9-a3c6fcfe63fa admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.442623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.443301 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.443584 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.443857 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] PATH_INFO: `/v3/projects/8e5c511aaa624e768ce427de0f6c054c/users/0fd82bedeb884746bf05e529c462c728/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.448424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c511aaa624e768ce427de0f6c054c, user_id=0fd82bedeb884746bf05e529c462c728, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.449566 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.484348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1376/2765] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:34 2022] PUT /identity/v3/projects/8e5c511aaa624e768ce427de0f6c054c/users/0fd82bedeb884746bf05e529c462c728/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:34.484981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.485446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.485724 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.527937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] MFA Rules not processed for user `0fd82bedeb884746bf05e529c462c728`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:34.529490 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:34.616004 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1390/2766] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:34 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:34.632958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.634752 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:34.710932 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0790b00-526f-4589-8f66-99ead1341e9a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.714742 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.715412 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.715786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.716056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.726813 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.728367 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:34.739561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1377/2767] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:34.908761 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:34.910288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:34.923730 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242901e-07a1-4e86-ab56-6cda4de5d156 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:34.928099 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:34.930575 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:34.931166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:34.931696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:34.967945 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:34.998205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:34.999655 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b7c9-051e-4d34-bf34-aca0274c86de service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:35.008654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1391/2768] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:43.407215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:43.478182 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9c15c-ee24-4693-bbdc-090b078628ee service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:43.482930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:43.483562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:43.483844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:43.484119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] PATH_INFO: `/v3/users/426bc978debf4e67b589506fc149344e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:43.485233 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426bc978debf4e67b589506fc149344e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:43.487749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:43.504232 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:43.534968 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426bc978debf4e67b589506fc149344e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:43.535733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426bc978debf4e67b589506fc149344e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:43.548758 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426bc978debf4e67b589506fc149344e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:43.549482 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426bc978debf4e67b589506fc149344e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:43.558590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426bc978debf4e67b589506fc149344e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:43.571940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1378/2769] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:43 2022] DELETE /identity/v3/users/426bc978debf4e67b589506fc149344e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:43.576510 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:43.576971 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:43.577074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:43.599550 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:43.600746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:43.663007 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1392/2770] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:43.673225 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:43.674254 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:43.731500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d63f6-cc1a-4e13-9ad2-223b397e1e20 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:43.735064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:43.735653 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:43.735924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:43.736188 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:43.746781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:43.748489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:43.758372 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1379/2771] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:44.022591 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.023982 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:44.037407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15acb6-8ff8-46b6-8d6e-7f5d0bad9967 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.042005 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.043174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.043617 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.043926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] PATH_INFO: `/v3/projects/dae459c7acde4662a3a74d4d03376e75` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.045060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae459c7acde4662a3a74d4d03376e75)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.047008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:44.092786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae459c7acde4662a3a74d4d03376e75', 'request_id': 'req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.098406 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae459c7acde4662a3a74d4d03376e75', 'request_id': 'req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.105372 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae459c7acde4662a3a74d4d03376e75', 'request_id': 'req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.116496 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] The token cache is being invalidate because project dae459c7acde4662a3a74d4d03376e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:44.116786 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.117713 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.119288 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1393/2772] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:44 2022] DELETE /identity/v3/projects/dae459c7acde4662a3a74d4d03376e75 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:44.123198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.133190 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441355-f991-4dd9-a751-cbf9b5a626a0 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.187436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.188049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.188322 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.188590 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] PATH_INFO: `/v3/users/0fd82bedeb884746bf05e529c462c728` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.189674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd82bedeb884746bf05e529c462c728)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.192103 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:44.232024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:44.240692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd82bedeb884746bf05e529c462c728'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.241499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd82bedeb884746bf05e529c462c728'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.254485 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd82bedeb884746bf05e529c462c728'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.255135 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd82bedeb884746bf05e529c462c728'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.263334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3663d061-0f8e-4292-bb25-90f5e3c242de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd82bedeb884746bf05e529c462c728'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.276104 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1380/2773] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:44 2022] DELETE /identity/v3/users/0fd82bedeb884746bf05e529c462c728 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:44.542684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.544181 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:44.557507 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079d948-c5e6-4ffd-93f6-66d0d6fa2224 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.615111 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.615740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.616013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.616281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] PATH_INFO: `/v3/projects/8e5c511aaa624e768ce427de0f6c054c` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.617634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5c511aaa624e768ce427de0f6c054c)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.619588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:44.621091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:44.667328 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5c511aaa624e768ce427de0f6c054c', 'request_id': 'req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.672767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5c511aaa624e768ce427de0f6c054c', 'request_id': 'req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.681253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5c511aaa624e768ce427de0f6c054c', 'request_id': 'req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.694513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] The token cache is being invalidate because project 8e5c511aaa624e768ce427de0f6c054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:44.694801 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.695503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-85eb8ed0-a09d-40ae-9b98-f5e21517ceb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:44.696925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1394/2774] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:44 2022] DELETE /identity/v3/projects/8e5c511aaa624e768ce427de0f6c054c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:44.701982 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.702508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.702625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.721640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:44.722881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:44.785923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1381/2775] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:44.793646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.793934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.794262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.814178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:44.815387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:44.823286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1395/2776] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:44.827334 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.836802 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fbdd1-faf9-44e8-b207-c9f6c5020eba None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.841337 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.841923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.842228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.842496 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.843130 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:44.843426 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.844981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:44.856677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1382/2777] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:44.860821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.870326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5a7d7-23c7-4577-aa50-1e830d9ccde0 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.874940 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.875526 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.875804 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.876079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.876719 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.879163 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:44.907162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1396/2778] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:44 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:44.911273 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:44.921262 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af878c6-cd98-480c-9e57-65aa7ee6cb15 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:44.976037 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:44.976625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:44.976903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:44.977171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:44.977773 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:44.979696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.001152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1383/2779] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:44 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:45.005676 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.015953 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fa58f-d49b-47f8-901a-37cf17e9171e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.021230 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.021819 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.022137 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.022407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.023071 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.024654 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.034346 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1397/2780] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:45.038067 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.047682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe2b0c-a4de-4aa1-bc1c-02c96168ddb2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.052234 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.052812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.053091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.053362 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.054020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.055582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832215c2-6c0e-4e70-9c39-7d582f39b3c9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.066252 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1384/2781] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:45.070202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.079951 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2479a-23c9-4b5c-b37b-29f9874f4b1a admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.085214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.085843 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.086157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.086434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] PATH_INFO: `/v3/projects/2adc2025d3a64a67b282d1d89b0368b8/users/68f46dd45a124a8d9da607d957fe80aa/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.101680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adc2025d3a64a67b282d1d89b0368b8, user_id=68f46dd45a124a8d9da607d957fe80aa, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.104356 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.116579 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1398/2782] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:45 2022] PUT /identity/v3/projects/2adc2025d3a64a67b282d1d89b0368b8/users/68f46dd45a124a8d9da607d957fe80aa/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:45.128417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.128899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.129170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.155911 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] MFA Rules not processed for user `68f46dd45a124a8d9da607d957fe80aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:45.157098 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:45.166025 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:45.223427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1385/2783] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:45.227870 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.289107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343c649-ee92-4b53-8847-85afd7d5dcd8 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.293636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.294271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.294542 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.294802 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.295410 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.297287 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.328610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1399/2784] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:45 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:45.329760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.340266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78204b82-52fa-48f5-943b-b42b42e8b54b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.397097 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.397705 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.398000 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.398272 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.398885 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.400799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.421928 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1386/2785] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:45 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:45.426159 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.436596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514e384-9817-46e4-9f07-81a0536a8684 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.441492 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.442139 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.442416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.442679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.443316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.444936 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.450838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:45.460206 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1400/2786] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:45.464058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.475062 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f98f-1765-4305-8eb2-ce95f7d377f5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.479786 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.480431 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.480704 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.480972 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] PATH_INFO: `/v3/projects/c1051a1e7c1a49789c99d4aaf1577284/users/fa4ef505cf7d49ba8c057cb613bbfca3/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.495687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1051a1e7c1a49789c99d4aaf1577284, user_id=fa4ef505cf7d49ba8c057cb613bbfca3, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.498373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.511844 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1387/2787] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:45 2022] PUT /identity/v3/projects/c1051a1e7c1a49789c99d4aaf1577284/users/fa4ef505cf7d49ba8c057cb613bbfca3/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:45.515974 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.526756 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091bc58-c964-4626-a64f-73767eee8162 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.583596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.584120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.584394 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.584661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.585295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.586904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feeb76-ac30-4f45-ab49-a2b7e13f89aa admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.596917 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1401/2788] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:45.601172 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.611815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0cd3e-1d8b-4cbb-83f2-a3dd5405cf7a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.616899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.617808 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.618127 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.618517 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] PATH_INFO: `/v3/projects/c1051a1e7c1a49789c99d4aaf1577284/users/fa4ef505cf7d49ba8c057cb613bbfca3/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.620600 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1051a1e7c1a49789c99d4aaf1577284, user_id=fa4ef505cf7d49ba8c057cb613bbfca3, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.623099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.634090 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1388/2789] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:45 2022] PUT /identity/v3/projects/c1051a1e7c1a49789c99d4aaf1577284/users/fa4ef505cf7d49ba8c057cb613bbfca3/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:45.644536 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.645006 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.645127 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.678033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] MFA Rules not processed for user `fa4ef505cf7d49ba8c057cb613bbfca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:45.679359 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:45.750700 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1402/2790] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:45.761730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:45.763465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:45.838538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5eadb-809b-4724-ba71-5cec701fb921 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:45.854918 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:45.855943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:45.856136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:45.856507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:45.872961 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:45.874486 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd554-ab69-4740-92ec-9343e3f3d8e7 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:45.887415 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1389/2791] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:46.293478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:46.371767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e20a0-c86d-4112-adfc-c1e4554a4dc6 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:46.376295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:46.376925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:46.377203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:46.377612 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] PATH_INFO: `/v3/users/68f46dd45a124a8d9da607d957fe80aa` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:46.379194 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f46dd45a124a8d9da607d957fe80aa)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:46.382179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:46.423402 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:46.449758 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f46dd45a124a8d9da607d957fe80aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:46.450465 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f46dd45a124a8d9da607d957fe80aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:46.463212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f46dd45a124a8d9da607d957fe80aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:46.472422 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f46dd45a124a8d9da607d957fe80aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:46.480045 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f46dd45a124a8d9da607d957fe80aa'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:46.486340 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1403/2792] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:46 2022] DELETE /identity/v3/users/68f46dd45a124a8d9da607d957fe80aa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:46.491474 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:46.491755 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:46.492281 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:46.509571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:46.514072 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:46.515929 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:46.582245 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1390/2793] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:46.592073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:46.593637 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:46.661217 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898ad19-0287-45f7-b42c-af16249170a2 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:46.665407 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:46.666050 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:46.666351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:46.666622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:46.677383 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:46.678852 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2fe41-7f32-4f2e-8fe8-eafc0ccc4efc service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:46.688898 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1404/2794] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:46.964129 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:46.965593 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:46.978448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bae37-326b-485e-a705-ef611f65a139 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:46.983681 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:46.984055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:46.984283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:46.984736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] PATH_INFO: `/v3/projects/2adc2025d3a64a67b282d1d89b0368b8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:46.985978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adc2025d3a64a67b282d1d89b0368b8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:46.988619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:47.005741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.006446 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.006837 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.025992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] MFA Rules not processed for user `9dde4c5c4ce24c1a8b70334cd97c2d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:47.027228 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:47.038667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adc2025d3a64a67b282d1d89b0368b8', 'request_id': 'req-4de7ee42-bbd4-487f-aebb-def8041b7d4c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.044295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adc2025d3a64a67b282d1d89b0368b8', 'request_id': 'req-4de7ee42-bbd4-487f-aebb-def8041b7d4c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.051996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adc2025d3a64a67b282d1d89b0368b8', 'request_id': 'req-4de7ee42-bbd4-487f-aebb-def8041b7d4c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.063092 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] The token cache is being invalidate because project 2adc2025d3a64a67b282d1d89b0368b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:47.063376 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.064004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.066044 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1391/2795] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:46 2022] DELETE /identity/v3/projects/2adc2025d3a64a67b282d1d89b0368b8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:47.069824 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:47.071136 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:47.084347 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1405/2796] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:47.137197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ee42-bbd4-487f-aebb-def8041b7d4c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:47.141881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:47.142534 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.142812 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.143083 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] PATH_INFO: `/v3/users/fa4ef505cf7d49ba8c057cb613bbfca3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.144269 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4ef505cf7d49ba8c057cb613bbfca3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:47.146198 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:47.182547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:47.196934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4ef505cf7d49ba8c057cb613bbfca3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.197666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4ef505cf7d49ba8c057cb613bbfca3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.213597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4ef505cf7d49ba8c057cb613bbfca3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.214359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4ef505cf7d49ba8c057cb613bbfca3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.222396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e3649292-a061-4e81-a9e0-aba8892a0195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4ef505cf7d49ba8c057cb613bbfca3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.235666 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1392/2797] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:47 2022] DELETE /identity/v3/users/fa4ef505cf7d49ba8c057cb613bbfca3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:34:47.511354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:47.523077 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57831674-fe29-48b4-8366-e89ab518eb59 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:47.578275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:47.593404 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:47.594107 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.594388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.594666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] PATH_INFO: `/v3/projects/c1051a1e7c1a49789c99d4aaf1577284` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.595790 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1051a1e7c1a49789c99d4aaf1577284)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:47.598646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:47.655261 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1051a1e7c1a49789c99d4aaf1577284', 'request_id': 'req-c31204a9-0047-4120-a0b2-fc829187414f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.662731 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1051a1e7c1a49789c99d4aaf1577284', 'request_id': 'req-c31204a9-0047-4120-a0b2-fc829187414f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.671443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1051a1e7c1a49789c99d4aaf1577284', 'request_id': 'req-c31204a9-0047-4120-a0b2-fc829187414f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.683683 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] The token cache is being invalidate because project c1051a1e7c1a49789c99d4aaf1577284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:47.683979 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.684621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-c31204a9-0047-4120-a0b2-fc829187414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:47.686684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1406/2798] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:47 2022] DELETE /identity/v3/projects/c1051a1e7c1a49789c99d4aaf1577284 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:47.691672 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.692143 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.692610 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.719059 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:47.720260 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:47.789390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1393/2799] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:34:47.797183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.797548 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.797891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.819024 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:47.820289 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:47.828782 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1407/2800] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:47.833154 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:47.842506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023caaa-6959-4973-ae0b-41820165a019 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:47.847873 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:47.848401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.848671 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.848935 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.849564 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:47.849860 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:47.851456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:47.875417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1394/2801] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:47.876604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:47.886461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fc3df-f0b3-44ad-acaf-e58b311e0ac4 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:47.891286 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:47.891955 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:47.892298 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:47.892636 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:47.893306 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:47.895560 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:47.930203 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1408/2802] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:47 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:47.931335 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:47.941633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938324c0-0b3f-4b6f-bb55-5d6299659d19 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.000391 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.001230 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.001501 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.001816 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.002625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.004572 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.025400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1395/2803] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:47 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:48.029634 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.040663 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d24513-a631-4046-bceb-bc9d3fadcb54 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.045253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.045946 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.046258 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.046529 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.047171 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.048767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.059154 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1409/2804] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:48.062894 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.072601 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955a698-2f39-4075-9878-0554cc703581 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.077175 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.077751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.078078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.078349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.078978 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.080562 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a480c4-abd7-46ae-8e66-3fc986f8c745 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.090907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1396/2805] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:48.094666 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.105336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace3ee-a919-4644-97b0-91454e87893d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.109991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.110647 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.110911 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.111183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] PATH_INFO: `/v3/projects/e5224964b3ed4e269e405d3986eeedb9/users/80e60124159a4cbb8ec8e4960f4cce88/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.126303 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5224964b3ed4e269e405d3986eeedb9, user_id=80e60124159a4cbb8ec8e4960f4cce88, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.129031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.141399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1410/2806] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:48 2022] PUT /identity/v3/projects/e5224964b3ed4e269e405d3986eeedb9/users/80e60124159a4cbb8ec8e4960f4cce88/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:48.206522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.206821 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.207118 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.234418 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] MFA Rules not processed for user `80e60124159a4cbb8ec8e4960f4cce88`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:48.235654 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:48.239547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:48.300475 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1397/2807] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:48.311552 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.313225 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:48.371273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f65c2-8e1a-4fc7-8cbb-76ab05dfc815 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.375025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.375627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.375901 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.376167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.384524 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.385939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb737cb-28a6-4ddf-9179-348d4b84c985 service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.395065 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1411/2808] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:48.420168 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.481739 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3846818-d8a6-4265-8f46-644c911d65ce None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.486285 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.486903 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.487181 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.487452 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] PATH_INFO: `/v3/users/80e60124159a4cbb8ec8e4960f4cce88` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.488565 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e60124159a4cbb8ec8e4960f4cce88)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.490506 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.536747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e60124159a4cbb8ec8e4960f4cce88'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:48.537427 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e60124159a4cbb8ec8e4960f4cce88'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:48.549134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e60124159a4cbb8ec8e4960f4cce88'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:48.549790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e60124159a4cbb8ec8e4960f4cce88'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:48.557319 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e60124159a4cbb8ec8e4960f4cce88'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:48.569869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1398/2809] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:34:48 2022] DELETE /identity/v3/users/80e60124159a4cbb8ec8e4960f4cce88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:48.574458 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.574748 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.575049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.593811 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:48.595025 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:48.606590 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:48.656469 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1412/2810] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:48.666131 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:48.667522 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:48.695429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:48.726966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375be94-9878-49e3-9839-916ad7ed0e1e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:48.731013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:48.731538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:48.731901 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:48.732123 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:48.741315 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:48.743027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976dee3-a622-4154-b480-54b931ae732d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:48.753115 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1399/2811] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:49.041445 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.042890 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:49.055337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020a2d3-cd71-4278-9d98-b0c9da004962 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.060251 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.060995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.061336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.061672 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] PATH_INFO: `/v3/projects/e5224964b3ed4e269e405d3986eeedb9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.063053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5224964b3ed4e269e405d3986eeedb9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.065831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.111083 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5224964b3ed4e269e405d3986eeedb9', 'request_id': 'req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:49.117574 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5224964b3ed4e269e405d3986eeedb9', 'request_id': 'req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:49.124712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5224964b3ed4e269e405d3986eeedb9', 'request_id': 'req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:49.140237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] The token cache is being invalidate because project e5224964b3ed4e269e405d3986eeedb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:34:49.140521 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:49.141148 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6b76970c-c2b8-4cb6-8a32-24c54a8403b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:34:49.142656 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1413/2812] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:34:49 2022] DELETE /identity/v3/projects/e5224964b3ed4e269e405d3986eeedb9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:49.147644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.148106 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.148204 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.166969 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:49.168167 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:49.228759 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1400/2813] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:49.236443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.236728 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.237571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.257480 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:49.258635 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:49.266476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1414/2814] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:49.270621 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.279943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e65db-c68b-47cb-9d05-52fb51a1e52c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.284964 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.285574 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.285843 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.286147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.286778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:34:49.287073 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.288624 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.300375 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1401/2815] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:34:49.304509 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.313795 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159b242-6617-4b58-8c55-a2644aa481b7 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.318646 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.319231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.319508 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.319775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] PATH_INFO: `/v3/projects` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.320399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.322451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.352344 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1415/2816] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:34:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:34:49.353858 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.365950 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e5a89-3a39-4525-9560-513a380d7b24 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.421142 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.421747 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.422066 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.422343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.422966 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.425476 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.445675 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1402/2817] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:34:49 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:34:49.449913 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.460242 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39752f68-7caa-4b6e-8443-99f8a6df922d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.465037 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.465627 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.465905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.466209 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.466848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.468430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.478774 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1416/2818] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:49.482646 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.493210 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9dad0a-9b97-4c9a-814d-b23c339acb6a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.497768 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.498389 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.498668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.498940 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.499642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.501520 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0ab79-1568-4a55-83e5-f82b824b595a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.511984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1403/2819] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:34:49.515821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.525650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38179f4-4139-4599-bb23-5be4d834e8d5 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.530268 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.530895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.531170 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.531438 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] PATH_INFO: `/v3/projects/25b64dfd6164420ba5ffe3b5c81585f2/users/2001cc902b3644488a7d9c58cbf5eb58/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.545947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b64dfd6164420ba5ffe3b5c81585f2, user_id=2001cc902b3644488a7d9c58cbf5eb58, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.548587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.561888 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1417/2820] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:34:49 2022] PUT /identity/v3/projects/25b64dfd6164420ba5ffe3b5c81585f2/users/2001cc902b3644488a7d9c58cbf5eb58/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:34:49.566907 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fcf8-5db9-4fd5-b1f5-a304b58b4eb3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.567224 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fcf8-5db9-4fd5-b1f5-a304b58b4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.567835 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fcf8-5db9-4fd5-b1f5-a304b58b4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.586302 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1a59fcf8-5db9-4fd5-b1f5-a304b58b4eb3 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:49.587489 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1a59fcf8-5db9-4fd5-b1f5-a304b58b4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:49.616872 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:49.648008 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1404/2821] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:49.657619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:49.660019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:49.699885 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:34:49.716476 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aee92-6502-430e-8d9f-0a69676e61a9 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:49.720089 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:49.720686 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:49.720960 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:49.721868 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:49.731067 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:49.732499 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:49.742257 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1418/2822] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:50.422001 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf3b1-5f93-436a-86fc-4fe5f595b3d8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:50.422542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf3b1-5f93-436a-86fc-4fe5f595b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:50.422542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf3b1-5f93-436a-86fc-4fe5f595b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:50.462944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-27bbf3b1-5f93-436a-86fc-4fe5f595b3d8 None None] MFA Rules not processed for user `2001cc902b3644488a7d9c58cbf5eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:50.464236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-27bbf3b1-5f93-436a-86fc-4fe5f595b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:50.554120 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1405/2823] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:34:50.563998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:34:50.567073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:50.636472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89ee52-2bc3-4911-8218-eec5945b3aac service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:34:50.641293 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:34:50.642195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:50.642581 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:50.643409 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:50.654367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:34:50.655931 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:34:50.669644 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1419/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:34:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:34:52.062751 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef24f-9aae-4ee9-9a98-62cf3948b6b0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:34:52.063283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef24f-9aae-4ee9-9a98-62cf3948b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:34:52.063283 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef24f-9aae-4ee9-9a98-62cf3948b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:34:52.093349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-abcef24f-9aae-4ee9-9a98-62cf3948b6b0 None None] MFA Rules not processed for user `2001cc902b3644488a7d9c58cbf5eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:34:52.094557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-abcef24f-9aae-4ee9-9a98-62cf3948b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:34:52.121867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1406/2825] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:34:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:00.662948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=35 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:02.119726 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=59 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:02.750190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:02.751594 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:02.819956 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e7601-a5a1-4f0b-a92e-fc139b0cf41f service cinder] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:02.825714 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:02.826473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:02.826747 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:02.827015 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] PATH_INFO: `/v3/users/3a6786145e8a48239f746d5d2ea16571` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:02.828164 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6786145e8a48239f746d5d2ea16571)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:02.830128 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:02.880073 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6786145e8a48239f746d5d2ea16571'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:02.880711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6786145e8a48239f746d5d2ea16571'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:02.892452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6786145e8a48239f746d5d2ea16571'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:02.902074 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6786145e8a48239f746d5d2ea16571'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:02.911229 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6786145e8a48239f746d5d2ea16571'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:02.917237 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1420/2826] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:35:02 2022] DELETE /identity/v3/users/3a6786145e8a48239f746d5d2ea16571 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:02.921699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:02.922013 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:02.922287 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:02.951170 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:02.952370 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.011578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1407/2827] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:03.021799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.023282 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.121028 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8811-c8dd-42ec-a37b-5f4000bae0fb admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:03.125009 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:03.125572 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.125848 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.126145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.136295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:03.137734 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273a2ec-8433-4e8b-a2ff-0ffaf8eff763 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:03.149596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1421/2828] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:35:03.578112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.579579 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.593668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44213a5b-0bdd-43db-862c-b7e8621a07ab None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:03.598398 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:03.599029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.599305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.599766 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] PATH_INFO: `/v3/projects/eda53424734e4571ba7ea8cd68ef34d4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.600881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda53424734e4571ba7ea8cd68ef34d4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:03.602815 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:03.648930 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda53424734e4571ba7ea8cd68ef34d4', 'request_id': 'req-fe94a6de-7a91-4740-8d26-aa33b10059d9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:03.654527 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda53424734e4571ba7ea8cd68ef34d4', 'request_id': 'req-fe94a6de-7a91-4740-8d26-aa33b10059d9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:03.662396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda53424734e4571ba7ea8cd68ef34d4', 'request_id': 'req-fe94a6de-7a91-4740-8d26-aa33b10059d9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:03.673228 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] The token cache is being invalidate because project eda53424734e4571ba7ea8cd68ef34d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:35:03.673507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:03.674141 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:03.675613 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1408/2829] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:35:03 2022] DELETE /identity/v3/projects/eda53424734e4571ba7ea8cd68ef34d4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:03.680589 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479fe1-cc3f-45b8-8667-8f36457393fb None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.680869 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479fe1-cc3f-45b8-8667-8f36457393fb None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.681187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11479fe1-cc3f-45b8-8667-8f36457393fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.692573 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:03.722999 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.724616 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.743846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-11479fe1-cc3f-45b8-8667-8f36457393fb None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:03.745767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-11479fe1-cc3f-45b8-8667-8f36457393fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.820222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1422/2830] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:35:03.828641 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.828919 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.829398 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.842317 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:03.852505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a6de-7a91-4740-8d26-aa33b10059d9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:03.858914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:03.859677 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.859942 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.860214 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.862492 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.868544 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:03.869712 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:03.874551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:03.876124 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:03.877411 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1423/2831] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:35:03.882033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.887551 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1409/2832] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:35:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:35:03.891351 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ccffa-6aba-46ff-ad1f-f54f5f86e0f1 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:03.896010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:03.896604 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.896882 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.897183 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.897860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:35:03.898199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:03.899821 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:03.913253 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1424/2833] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 07:35:03.917617 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.928727 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b868b1-bc67-43e7-b817-eaa4a20de5d4 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:03.933420 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:03.934112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:03.934395 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:03.934667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:03.935280 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:03.937200 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:03.963591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1410/2834] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:35:03 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:35:03.967716 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:03.977660 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ec52-58d3-4d36-b3eb-f56f8113f9ca admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:04.032326 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:04.032851 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.033152 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.033423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.034296 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:04.036216 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:04.056726 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1425/2835] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:35:03 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:35:04.060771 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:04.071387 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d8546-0297-4c94-af26-7eda175afaca admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:04.076205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:04.076797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.077078 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.077349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.078017 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:04.079604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:04.090231 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1411/2836] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:35:04.093947 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:04.104212 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3ee1-05d1-4d33-bae9-46d829ae2f99 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:04.109954 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:04.111010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.111358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.111831 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.113056 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:04.114784 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3092c25-a838-40b8-bd43-134317cd2ef1 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:04.128689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1426/2837] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:35:04.132597 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:04.143627 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf7ee-20d8-4fa6-a3fc-4f9231524195 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:04.148417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:04.149068 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.149345 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.149614 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] PATH_INFO: `/v3/projects/7eaf872dd2f4428ca13c52c4a06f7bdd/users/61223d3bd5d84a88bed479f055186dbf/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.166338 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eaf872dd2f4428ca13c52c4a06f7bdd, user_id=61223d3bd5d84a88bed479f055186dbf, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:04.169064 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:04.184026 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1412/2838] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:35:04 2022] PUT /identity/v3/projects/7eaf872dd2f4428ca13c52c4a06f7bdd/users/61223d3bd5d84a88bed479f055186dbf/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 07:35:04.188814 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b66f-5e25-40e9-98f2-66451b527183 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.189103 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b66f-5e25-40e9-98f2-66451b527183 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.189513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0b66f-5e25-40e9-98f2-66451b527183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.212060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-8ad0b66f-5e25-40e9-98f2-66451b527183 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:04.213308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-8ad0b66f-5e25-40e9-98f2-66451b527183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:04.257995 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:04.279580 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1427/2839] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:35:04.290045 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:04.291749 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:04.347914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858f199-8504-4449-a3cf-534577ffe315 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:04.351549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:04.352147 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:04.352417 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:04.352682 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:04.361733 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:04.363744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:04.374744 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1413/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:35:08.473495 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:08.474059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:08.474059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:08.505193 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] MFA Rules not processed for user `61223d3bd5d84a88bed479f055186dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:08.506461 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:08.579281 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1428/2841] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:08.583670 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:08.594373 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9e31-2651-4095-81f4-75d367008532 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:08.602194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:08.604582 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:08.605349 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:08.606757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:08.607657 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:08.610294 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:08.653619 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1414/2842] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:35:08 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 07:35:08.655661 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:08.683462 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3794e9-df19-48c6-bf79-cb9dcc475d6f None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:08.788608 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:08.789079 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:08.789454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:08.789825 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:08.790587 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:08.792777 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:08.830053 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1429/2843] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:35:08 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:35:08.835692 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:08.866266 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350238a-fd68-4630-b172-85c054c33ee7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:08.873048 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:08.874080 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:08.874542 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:08.874967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:08.875791 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:08.877827 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:08.898060 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1415/2844] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:35:08.901447 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:08.915767 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030372-606d-488c-a28f-827e67b4b969 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:08.921503 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:08.922166 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:08.922443 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:08.923309 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] PATH_INFO: `/v3/projects/e0ac5024b22f4d0f9524bf21e4948680/users/07dfaab2a31941f6837dd9972010253a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:08.944809 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ac5024b22f4d0f9524bf21e4948680, user_id=07dfaab2a31941f6837dd9972010253a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:08.947765 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:08.970321 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1430/2845] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:35:08 2022] PUT /identity/v3/projects/e0ac5024b22f4d0f9524bf21e4948680/users/07dfaab2a31941f6837dd9972010253a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:08.970983 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:08.987967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb567e-df6c-4dd0-9763-10855c1376e4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:09.056305 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:09.057138 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:09.057518 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:09.057899 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:09.058696 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:09.060571 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9926-c848-41f9-8493-33265423295d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:09.062455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:09.074838 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1416/2846] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 07:35:09.078705 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:09.089650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3f92-5393-4aaa-a10a-1fc3b5ff8650 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:09.101875 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:09.102886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:09.103275 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:09.103652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] PATH_INFO: `/v3/projects/e0ac5024b22f4d0f9524bf21e4948680/users/07dfaab2a31941f6837dd9972010253a/roles/94848c028a4945b3b8f06d5afa9dc987` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:09.105906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ac5024b22f4d0f9524bf21e4948680, user_id=07dfaab2a31941f6837dd9972010253a, role_id=94848c028a4945b3b8f06d5afa9dc987)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:09.109184 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:09.124775 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1431/2847] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:35:09 2022] PUT /identity/v3/projects/e0ac5024b22f4d0f9524bf21e4948680/users/07dfaab2a31941f6837dd9972010253a/roles/94848c028a4945b3b8f06d5afa9dc987 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:09.790957 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ee5b-3007-4190-a611-295e5f3a6e8f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:09.791513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ee5b-3007-4190-a611-295e5f3a6e8f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:09.791513 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ee5b-3007-4190-a611-295e5f3a6e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:09.835348 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c1a3ee5b-3007-4190-a611-295e5f3a6e8f None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:09.836967 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c1a3ee5b-3007-4190-a611-295e5f3a6e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:09.936890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1417/2848] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Aug 17 07:35:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:09.991266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:09.993531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:10.032104 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:10.087172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095080e-b6be-4795-9ec5-69de72ebb2bd admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:10.092313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:10.093681 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:10.093986 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:10.094452 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:10.107266 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:10.109126 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:10.130434 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1432/2849] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:35:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 07:35:15.496255 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5526f-edc7-43dc-b0ea-c4f3f5173934 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:15.496970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5526f-edc7-43dc-b0ea-c4f3f5173934 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:15.496970 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5526f-edc7-43dc-b0ea-c4f3f5173934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:15.540906 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c7f5526f-edc7-43dc-b0ea-c4f3f5173934 None None] MFA Rules not processed for user `07dfaab2a31941f6837dd9972010253a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:15.543099 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7f5526f-edc7-43dc-b0ea-c4f3f5173934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:15.653435 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1418/2850] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:15.672167 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:15.674214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:15.796267 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd0d4-1aaa-4216-800c-d5e1eabaaa3f service swift] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:15.803174 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:15.803963 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:15.804248 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:15.804515 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:15.879833 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:15.882222 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b807c7-cc2e-4498-800a-fa588bd51213 service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:15.893596 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1433/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:35:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:35:17.164463 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2434-106a-477d-988d-300523b380d7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:17.165469 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2434-106a-477d-988d-300523b380d7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:17.166010 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2434-106a-477d-988d-300523b380d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:17.191879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-888c2434-106a-477d-988d-300523b380d7 None None] MFA Rules not processed for user `61223d3bd5d84a88bed479f055186dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:17.193503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-888c2434-106a-477d-988d-300523b380d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:17.206196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1419/2852] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:25.888470 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=86 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:27.183944 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=71 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:36.154914 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:36.155423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:36.155423 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:36.174932 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] MFA Rules not processed for user `8499dabf82534db393da7811d003c4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:36.176120 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:36.184091 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1434/2853] 10.222.0.45 () {58 vars in 967 bytes} [Wed Aug 17 07:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:36.196962 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2434-106a-477d-988d-300523b380d7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:36.209215 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2434-106a-477d-988d-300523b380d7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:36.214984 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89eb038259df4fbab0b03d2157e3d55c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:36.215623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:36.215921 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:36.216197 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:36.224667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:36.226292 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:36.238205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1420/2854] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Aug 17 07:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 07:35:38.163473 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.164891 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:38.237926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9e3b8-de7a-40ff-91fb-737908d64715 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:38.243667 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:38.244412 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.244741 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.245010 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] PATH_INFO: `/v3/users/9dde4c5c4ce24c1a8b70334cd97c2d7f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.246313 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dde4c5c4ce24c1a8b70334cd97c2d7f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:38.248744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:38.300680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dde4c5c4ce24c1a8b70334cd97c2d7f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.301823 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dde4c5c4ce24c1a8b70334cd97c2d7f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.314399 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dde4c5c4ce24c1a8b70334cd97c2d7f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.322290 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dde4c5c4ce24c1a8b70334cd97c2d7f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.329691 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-eca88a71-2f77-474f-b903-05f89a921803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dde4c5c4ce24c1a8b70334cd97c2d7f'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.336157 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1435/2855] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:35:38 2022] DELETE /identity/v3/users/9dde4c5c4ce24c1a8b70334cd97c2d7f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:38.514547 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.526251 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3b1bc-ad9a-42ff-9dec-97b6f00cef50 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:38.589943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:38.590583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.590862 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.591134 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] PATH_INFO: `/v3/projects/2f7df2edf05f4cb597d67dfdea4f94e2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.592229 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7df2edf05f4cb597d67dfdea4f94e2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:38.594150 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:38.638914 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7df2edf05f4cb597d67dfdea4f94e2', 'request_id': 'req-fd19fc91-c69e-4386-adec-86b6c8df7737'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.644323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7df2edf05f4cb597d67dfdea4f94e2', 'request_id': 'req-fd19fc91-c69e-4386-adec-86b6c8df7737'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.651958 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7df2edf05f4cb597d67dfdea4f94e2', 'request_id': 'req-fd19fc91-c69e-4386-adec-86b6c8df7737'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.662898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] The token cache is being invalidate because project 2f7df2edf05f4cb597d67dfdea4f94e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:35:38.663186 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.663817 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fd19fc91-c69e-4386-adec-86b6c8df7737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:35:38.665430 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1421/2856] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:35:38 2022] DELETE /identity/v3/projects/2f7df2edf05f4cb597d67dfdea4f94e2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:38.670708 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.671208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.671477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.692336 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:38.694106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:38.753187 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1436/2857] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:35:38.761640 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.761869 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.762176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.782673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:38.783876 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:38.791875 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1422/2858] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:38.796273 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.806364 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc57b2-3170-4fe1-9e87-583a6005dd81 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:38.810972 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:38.811567 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.811838 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.812110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] PATH_INFO: `/v3/domains` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.812746 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81522) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 07:35:38.813040 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:38.814771 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:38.823737 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:38.827532 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1437/2859] 10.222.0.45 () {58 vars in 1153 bytes} [Wed Aug 17 07:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 07:35:38.831939 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.847985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad274c1d-35cd-4f72-826a-992db662f602 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:38.856736 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:38.857332 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.857629 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.857879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.858535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:38.860507 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:38.888737 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1423/2860] 10.222.0.45 () {60 vars in 1153 bytes} [Wed Aug 17 07:35:38 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:35:38.892842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.903500 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a7ca-f338-4381-960a-715b995f059d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:38.958659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:38.959792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:38.960068 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:38.960337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] PATH_INFO: `/v3/users` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:38.960959 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:38.962918 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:38.983305 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1438/2861] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Aug 17 07:35:38 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 07:35:38.988020 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:38.998436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c241b-2ddd-487f-949d-92491ec21e79 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:39.002913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:39.003519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:39.003792 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:39.004056 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:39.004689 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:39.006926 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:39.017171 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1424/2862] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:35:39.022031 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:39.032926 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b83e3-d122-4ea5-9ede-8931afe4404e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:39.037889 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:39.038520 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:39.038793 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:39.039122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:39.039751 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:39.041366 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148e64-4963-4a82-b4cc-9178ec69b98d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:39.053308 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1439/2863] 10.222.0.45 () {58 vars in 1122 bytes} [Wed Aug 17 07:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 07:35:39.057879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:39.069734 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147472fc-2c2a-4dc7-bdc3-f13036f9be99 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:39.080905 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:39.081591 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:39.081863 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:39.082161 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] PATH_INFO: `/v3/projects/75e8a0c8a9e54fb1a550044142aa69bb/users/20216b916e0740cbbc7854412ba8a98a/roles/9e04db42a455473b8b84df28c1a357fc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:39.098024 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e8a0c8a9e54fb1a550044142aa69bb, user_id=20216b916e0740cbbc7854412ba8a98a, role_id=9e04db42a455473b8b84df28c1a357fc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:39.100673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:39.112826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1425/2864] 10.222.0.45 () {60 vars in 1483 bytes} [Wed Aug 17 07:35:39 2022] PUT /identity/v3/projects/75e8a0c8a9e54fb1a550044142aa69bb/users/20216b916e0740cbbc7854412ba8a98a/roles/9e04db42a455473b8b84df28c1a357fc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:35:39.125904 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:39.126205 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:39.126472 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:39.156198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] MFA Rules not processed for user `20216b916e0740cbbc7854412ba8a98a`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:35:39.157386 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:39.220864 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1440/2865] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:35:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:35:39.232177 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:35:39.233890 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:35:39.252356 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:39.313256 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57031808-20e8-405b-9af6-e8cf71a042b2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:35:39.316797 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:35:39.317390 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:35:39.317659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:35:39.317924 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:35:39.326477 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:35:39.327879 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2221c-318d-4fde-b24a-3df6b8421232 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:35:39.336644 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1426/2866] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:35:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:35:49.217610 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:35:49.332778 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=29 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:09.328744 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:09.330178 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:09.420906 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528f08f-8af3-4577-b0b0-1db3b5722e27 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:09.424505 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:09.425106 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:09.425385 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:09.425659 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:09.427424 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:09.489905 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:09.491387 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:09.501131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1441/2867] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:36:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:36:19.496887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=59 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:19.848790 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f6e7-e33d-45f2-aa3d-bae05dcc0449 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:19.849299 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f6e7-e33d-45f2-aa3d-bae05dcc0449 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:19.849402 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19f6e7-e33d-45f2-aa3d-bae05dcc0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:19.867886 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3e19f6e7-e33d-45f2-aa3d-bae05dcc0449 None None] MFA Rules not processed for user `2001cc902b3644488a7d9c58cbf5eb58`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:36:19.869063 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3e19f6e7-e33d-45f2-aa3d-bae05dcc0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:19.928472 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1427/2868] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:36:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:36:27.078464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:27.141796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1876-c28a-418c-9010-fa061a286197 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:27.146304 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:27.146925 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:27.147195 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:27.147481 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] PATH_INFO: `/v3/users/20216b916e0740cbbc7854412ba8a98a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:27.148584 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] RBAC: Authorizing `identity:delete_user(user_id=20216b916e0740cbbc7854412ba8a98a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:27.150502 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:27.204939 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20216b916e0740cbbc7854412ba8a98a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:27.206430 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20216b916e0740cbbc7854412ba8a98a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:27.218679 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20216b916e0740cbbc7854412ba8a98a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:27.229162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20216b916e0740cbbc7854412ba8a98a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:27.237780 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20216b916e0740cbbc7854412ba8a98a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:27.244723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1442/2869] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:36:27 2022] DELETE /identity/v3/users/20216b916e0740cbbc7854412ba8a98a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:27.249687 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:27.250232 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:27.250333 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:27.270343 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] MFA Rules not processed for user `385e8184512a438fb380879d377e1eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:36:27.271577 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:27.335462 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1428/2870] 10.222.0.45 () {58 vars in 958 bytes} [Wed Aug 17 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:36:27.345541 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:27.347017 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:27.415652 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc4e72-5ffd-4986-96e7-9487608a024f admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:27.419527 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:27.420149 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:27.420451 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:27.420717 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:27.434316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:27.435937 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:27.446729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1443/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:36:28.055055 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:28.056659 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:28.070620 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc4cb0-83c8-4b74-8b7c-e3263a4ea002 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:28.075157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:28.076538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:28.077176 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:28.077456 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] PATH_INFO: `/v3/projects/75e8a0c8a9e54fb1a550044142aa69bb` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:28.078690 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e8a0c8a9e54fb1a550044142aa69bb)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:28.080450 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:28.139583 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e8a0c8a9e54fb1a550044142aa69bb', 'request_id': 'req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:28.145110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e8a0c8a9e54fb1a550044142aa69bb', 'request_id': 'req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:28.153841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e8a0c8a9e54fb1a550044142aa69bb', 'request_id': 'req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:28.165538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] The token cache is being invalidate because project 75e8a0c8a9e54fb1a550044142aa69bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:36:28.166022 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:28.166667 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:28.168180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1429/2872] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:36:28 2022] DELETE /identity/v3/projects/75e8a0c8a9e54fb1a550044142aa69bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:31.904453 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:31.905934 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:31.919513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e94e60-a4ab-4ad5-bf56-554e278b2fe7 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:31.938449 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:31.971022 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:31.971616 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:31.971887 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:31.972172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:31.973893 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:32.034997 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:32.036435 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:32.046622 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1444/2873] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:36:38.162295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:38.307538 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:38.309119 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:38.340503 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb3303-9db4-4c15-b614-b1f3ace09dc3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:38.345284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:38.346743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:38.346743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:38.346743 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] PATH_INFO: `/v3/users/b2e79830079c4aa9b95c4622bac45c74` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:38.347762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e79830079c4aa9b95c4622bac45c74)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:38.353180 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:38.397642 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e79830079c4aa9b95c4622bac45c74'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.398249 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e79830079c4aa9b95c4622bac45c74'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.410049 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e79830079c4aa9b95c4622bac45c74'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.410669 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e79830079c4aa9b95c4622bac45c74'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.419339 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e79830079c4aa9b95c4622bac45c74'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.431158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1430/2874] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:36:38 2022] DELETE /identity/v3/users/b2e79830079c4aa9b95c4622bac45c74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:38.602553 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:38.614291 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfe8e4-696b-43f7-acb1-05c3ec399b56 service neutron] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:38.672650 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:38.673199 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:38.673478 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:38.673749 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] PATH_INFO: `/v3/projects/afb93daca17c466da3a698536c6b323f` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:38.674886 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb93daca17c466da3a698536c6b323f)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:38.676830 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:38.721792 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb93daca17c466da3a698536c6b323f', 'request_id': 'req-307a8c7f-c799-42da-8a8c-f614ab09e0ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.727172 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb93daca17c466da3a698536c6b323f', 'request_id': 'req-307a8c7f-c799-42da-8a8c-f614ab09e0ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.734150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb93daca17c466da3a698536c6b323f', 'request_id': 'req-307a8c7f-c799-42da-8a8c-f614ab09e0ea'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.745246 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] The token cache is being invalidate because project afb93daca17c466da3a698536c6b323f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:36:38.745531 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.746224 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.747696 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1445/2875] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:36:38 2022] DELETE /identity/v3/projects/afb93daca17c466da3a698536c6b323f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:38.751934 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:38.753336 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:38.766814 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaac25-f4f1-422f-ae8f-ade79e8639b7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:38.821578 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:38.822227 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:38.822508 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:38.822783 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] PATH_INFO: `/v3/users/0ccfbeec090043f1aba4dd16027e20bf` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:38.823896 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccfbeec090043f1aba4dd16027e20bf)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:38.825798 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:38.871722 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccfbeec090043f1aba4dd16027e20bf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.872382 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccfbeec090043f1aba4dd16027e20bf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.884647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccfbeec090043f1aba4dd16027e20bf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.885275 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccfbeec090043f1aba4dd16027e20bf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.892549 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccfbeec090043f1aba4dd16027e20bf'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:38.894651 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:38.907307 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1431/2876] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:36:38 2022] DELETE /identity/v3/users/0ccfbeec090043f1aba4dd16027e20bf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:39.082929 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:39.084417 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:39.092168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:39.110295 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8c7f-c799-42da-8a8c-f614ab09e0ea admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:39.182312 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:39.182998 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:39.183271 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:39.183533 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] PATH_INFO: `/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:39.184642 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c430f9bbb7f746749b5951a3f5f25fb9)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:39.186568 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:39.233013 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c430f9bbb7f746749b5951a3f5f25fb9', 'request_id': 'req-f56021ce-a029-476f-be40-5f418b182f4e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:39.238380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c430f9bbb7f746749b5951a3f5f25fb9', 'request_id': 'req-f56021ce-a029-476f-be40-5f418b182f4e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:39.246122 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c430f9bbb7f746749b5951a3f5f25fb9', 'request_id': 'req-f56021ce-a029-476f-be40-5f418b182f4e'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:39.257619 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] The token cache is being invalidate because project c430f9bbb7f746749b5951a3f5f25fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81522) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:36:39.257907 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:39.258565 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:36:39.260032 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1446/2877] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:36:39 2022] DELETE /identity/v3/projects/c430f9bbb7f746749b5951a3f5f25fb9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:36:47.699446 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:36:47.700826 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:47.756830 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282d998-4256-44a1-956e-ceb8b86bd3b7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:36:47.803027 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0db8a7774fb34badb9da9e2385ef89f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:36:47.803626 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:36:47.803923 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:36:47.804192 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:36:47.805881 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:36:47.874206 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:36:47.875729 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:36:47.886762 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1432/2878] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:36:49.253924 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:36:57.881975 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=78 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:37:14.506231 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:37:14.508388 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:37:14.571846 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56021ce-a029-476f-be40-5f418b182f4e admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:37:14.576810 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:37:14.577442 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:37:14.577740 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:37:14.578033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] PATH_INFO: `/v3/users/2001cc902b3644488a7d9c58cbf5eb58` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:37:14.579198 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2001cc902b3644488a7d9c58cbf5eb58)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:37:14.581210 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:37:14.626343 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2001cc902b3644488a7d9c58cbf5eb58'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.626991 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2001cc902b3644488a7d9c58cbf5eb58'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.639090 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2001cc902b3644488a7d9c58cbf5eb58'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.645948 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2001cc902b3644488a7d9c58cbf5eb58'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.653277 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2001cc902b3644488a7d9c58cbf5eb58'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.659033 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1447/2879] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:37:14 2022] DELETE /identity/v3/users/2001cc902b3644488a7d9c58cbf5eb58 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:37:14.824074 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:37:14.834573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b30a-7d7b-48ba-972f-c4c4ea425a4f service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:37:14.893347 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:37:14.893981 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:37:14.894267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:37:14.894535 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] PATH_INFO: `/v3/projects/25b64dfd6164420ba5ffe3b5c81585f2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:37:14.895623 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b64dfd6164420ba5ffe3b5c81585f2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:37:14.897499 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:37:14.943240 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b64dfd6164420ba5ffe3b5c81585f2', 'request_id': 'req-8bf6948a-50d8-4673-ba33-f60fe7c947c3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.949189 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b64dfd6164420ba5ffe3b5c81585f2', 'request_id': 'req-8bf6948a-50d8-4673-ba33-f60fe7c947c3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.956505 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b64dfd6164420ba5ffe3b5c81585f2', 'request_id': 'req-8bf6948a-50d8-4673-ba33-f60fe7c947c3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.967365 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] The token cache is being invalidate because project 25b64dfd6164420ba5ffe3b5c81585f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:37:14.967647 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.968263 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:37:14.969799 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1433/2880] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:37:14 2022] DELETE /identity/v3/projects/25b64dfd6164420ba5ffe3b5c81585f2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:37:24.655675 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:37:24.964429 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:09.420427 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:09.421981 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:09.478319 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4addfee-70dc-476d-80c1-a692757d41a7 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:09.524978 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:09.525571 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:09.525860 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:09.526145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:09.527835 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:09.537030 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:09.538475 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a8aaa-d4db-4481-b362-34e4911528d8 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:09.546416 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1448/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:19.542873 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=46 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:19.771660 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:19.773152 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:19.785201 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6948a-50d8-4673-ba33-f60fe7c947c3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:19.788674 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:19.789257 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:19.789532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:19.789800 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:19.791447 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:19.858784 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:19.860196 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217e8d-595f-4ca5-a942-9edb6b1f295b service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:19.871560 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1434/2882] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:29.866058 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=34 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:31.818842 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955ccd-2752-4cf7-9d85-0e32e31edd74 None None] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:31.819367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955ccd-2752-4cf7-9d85-0e32e31edd74 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:31.819367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63955ccd-2752-4cf7-9d85-0e32e31edd74 None None] PATH_INFO: `/` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:31.821338 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1449/2883] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:38:31.827424 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cd8b-f667-452f-9126-d2d3007d4757 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:31.827898 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cd8b-f667-452f-9126-d2d3007d4757 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:31.827996 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cd8b-f667-452f-9126-d2d3007d4757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:31.866295 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f680cd8b-f667-452f-9126-d2d3007d4757 None None] MFA Rules not processed for user `fd324314c13743779330b7eb52a1a834`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:38:31.868069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f680cd8b-f667-452f-9126-d2d3007d4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:31.875304 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1435/2884] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:38:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 07:38:31.887311 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955ccd-2752-4cf7-9d85-0e32e31edd74 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:31.898420 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63955ccd-2752-4cf7-9d85-0e32e31edd74 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:31.901992 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:31.902588 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:31.902861 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:31.903131 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:31.910264 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:31.911695 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc9a5-f897-443a-a432-a36e8fd18e94 service neutron] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:31.919799 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1450/2885] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:33.018480 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f24a9-26e5-4a7a-af44-321c554fa1ca None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:33.018963 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f24a9-26e5-4a7a-af44-321c554fa1ca None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:33.019069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f24a9-26e5-4a7a-af44-321c554fa1ca None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:33.020378 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1436/2886] 10.222.0.45 () {54 vars in 921 bytes} [Wed Aug 17 07:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 07:38:33.026112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] REQUEST_METHOD: `POST` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:33.026601 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:33.026710 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:33.064168 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.auth.core [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] MFA Rules not processed for user `36a43ff4bca2482d871b6f8b7dec3a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81522) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 07:38:33.065354 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:33.075367 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1451/2887] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Aug 17 07:38:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 07:38:33.088110 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f24a9-26e5-4a7a-af44-321c554fa1ca None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:33.098900 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f24a9-26e5-4a7a-af44-321c554fa1ca None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:33.102781 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:33.103004 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:33.103284 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:33.103557 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:33.114034 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:33.115561 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:33.126746 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1437/2888] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:33.190019 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:33.191389 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:33.259316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d097e9-707e-4420-8774-c37224c06433 None None] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:33.264179 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:33.264776 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:33.265049 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:33.265316 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:33.267011 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:33.278115 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:33.279680 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:33.289401 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1452/2889] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:35.432396 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:38:35.434633 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:35.450730 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ccbd-f58f-4bc0-b2ea-c6a651641b28 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:38:35.456625 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:38:35.457236 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:38:35.457515 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:38:35.457788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:38:35.459573 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:38:35.475312 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:38:35.477465 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:38:35.495276 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1438/2890] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:38:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:38:43.285202 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=47 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:38:45.486070 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=21 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:03.138325 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:03.140392 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:03.167878 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89339775-4d6e-4db0-ab1f-3e8605260a01 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:03.180796 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:03.181513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:03.181812 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:03.182094 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:03.183921 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:03.201060 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:03.202711 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:03.216603 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1453/2891] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:05.581112 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:05.595392 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee37a-9f19-45ff-9935-a3be38707945 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:05.601943 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36a43ff4bca2482d871b6f8b7dec3a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:05.602709 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:05.602913 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:05.603209 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:05.605608 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:05.620532 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:05.622157 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:05.634069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1439/2892] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:06.246262 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:06.247662 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:06.261854 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5c9f7-691f-4656-b2f7-e86238af8f0e service nova] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:06.267358 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:06.267942 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:06.268214 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:06.268477 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:06.270208 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:06.281175 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:06.282803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:06.292684 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1454/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:07.209448 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:07.219002 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d51eb-3d19-41d1-aec3-e536a785a7d1 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:07.222818 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd324314c13743779330b7eb52a1a834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:07.223401 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:07.223673 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:07.223938 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:07.225761 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:07.289760 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:07.291239 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:07.301329 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1440/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:10.061155 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:10.072234 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df24828-29bd-4635-b9bd-26e5f3f2987f service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:10.077621 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:10.078464 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:10.078859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:10.079190 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:10.081538 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:10.097785 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:10.101895 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:10.115546 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1455/2895] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:12.965852 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:12.978529 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883749b6-cd35-4760-8e3a-fa7208d5c7b4 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:12.984455 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:12.985359 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:12.985699 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:12.986069 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:12.988801 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:13.002936 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:13.004516 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:13.017436 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1441/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:40:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:40:13.028244 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:13.030324 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:13.045150 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce668a-2261-4120-8886-2179c408f1a1 service placement] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:13.050482 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:13.051130 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:13.051439 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:13.051881 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] PATH_INFO: `/v3/users/61223d3bd5d84a88bed479f055186dbf` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:13.052988 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61223d3bd5d84a88bed479f055186dbf)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:13.055008 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:13.101380 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61223d3bd5d84a88bed479f055186dbf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.102059 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61223d3bd5d84a88bed479f055186dbf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.113908 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61223d3bd5d84a88bed479f055186dbf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.121299 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61223d3bd5d84a88bed479f055186dbf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.128593 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61223d3bd5d84a88bed479f055186dbf'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.134454 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1456/2897] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:40:13 2022] DELETE /identity/v3/users/61223d3bd5d84a88bed479f055186dbf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:40:13.310258 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:13.323400 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad8bb8-e5de-42da-a339-11f71de279be service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:13.381841 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:13.382500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:13.382779 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:13.383051 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] PATH_INFO: `/v3/projects/7eaf872dd2f4428ca13c52c4a06f7bdd` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:13.384158 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eaf872dd2f4428ca13c52c4a06f7bdd)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:13.386091 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:13.433606 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'request_id': 'req-ce2116d8-75dc-4228-99d4-d28de27168f4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.439217 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'request_id': 'req-ce2116d8-75dc-4228-99d4-d28de27168f4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.446867 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eaf872dd2f4428ca13c52c4a06f7bdd', 'request_id': 'req-ce2116d8-75dc-4228-99d4-d28de27168f4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.453663 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:13.459500 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] The token cache is being invalidate because project 7eaf872dd2f4428ca13c52c4a06f7bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:40:13.459956 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.460985 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.462668 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1442/2898] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:40:13 2022] DELETE /identity/v3/projects/7eaf872dd2f4428ca13c52c4a06f7bdd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:40:13.466725 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:13.468162 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:13.481112 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e7434-bc58-4b94-93a0-994ebd256d40 admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:13.537145 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:13.537803 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:13.538110 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:13.538390 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] PATH_INFO: `/v3/users/07dfaab2a31941f6837dd9972010253a` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:13.539745 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07dfaab2a31941f6837dd9972010253a)` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:13.541689 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:13.577783 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:13.588682 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07dfaab2a31941f6837dd9972010253a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.589337 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07dfaab2a31941f6837dd9972010253a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.601213 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07dfaab2a31941f6837dd9972010253a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.608729 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07dfaab2a31941f6837dd9972010253a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.615760 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.notifications [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07dfaab2a31941f6837dd9972010253a'} {{(pid=81522) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.621859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1457/2899] 10.222.0.45 () {58 vars in 1224 bytes} [Wed Aug 17 07:40:13 2022] DELETE /identity/v3/users/07dfaab2a31941f6837dd9972010253a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:40:13.797788 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:40:13.799757 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:40:13.812194 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2116d8-75dc-4228-99d4-d28de27168f4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:40:13.869029 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '385e8184512a438fb380879d377e1eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93dca03ccb1d4c01b8cd3b051645d149', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:40:13.869655 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:40:13.870205 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:40:13.870495 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] PATH_INFO: `/v3/projects/e0ac5024b22f4d0f9524bf21e4948680` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:40:13.871604 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ac5024b22f4d0f9524bf21e4948680)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:40:13.873509 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:40:13.917831 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ac5024b22f4d0f9524bf21e4948680', 'request_id': 'req-57e70387-71f7-4eb0-aa8a-b677ece0e17a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.923267 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ac5024b22f4d0f9524bf21e4948680', 'request_id': 'req-57e70387-71f7-4eb0-aa8a-b677ece0e17a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.931519 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ac5024b22f4d0f9524bf21e4948680', 'request_id': 'req-57e70387-71f7-4eb0-aa8a-b677ece0e17a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.942954 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] The token cache is being invalidate because project e0ac5024b22f4d0f9524bf21e4948680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 07:40:13.943244 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.943866 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-57e70387-71f7-4eb0-aa8a-b677ece0e17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 07:40:13.945323 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1443/2900] 10.222.0.45 () {58 vars in 1233 bytes} [Wed Aug 17 07:40:13 2022] DELETE /identity/v3/projects/e0ac5024b22f4d0f9524bf21e4948680 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 07:40:23.618239 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:40:23.939320 dv-cinder-853126-2-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 07:45:13.700513 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Authenticating user token {{(pid=81522) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 07:45:13.701916 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:45:13.846557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8484-8c0d-4274-b83c-4b6d9a11ee6d admin admin] Validating token access rules against request {{(pid=81522) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 07:45:13.902723 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1acf20f6174d5c91f37c7da6dd9e47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62678f101b3547859f187a24aa31f563', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81522) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 07:45:13.903317 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] REQUEST_METHOD: `GET` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 07:45:13.903592 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] SCRIPT_NAME: `/identity` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 07:45:13.903859 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81522) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 07:45:13.905557 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.fernet_utils [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81522) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 07:45:13.916433 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 07:45:13.918036 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66487-ea03-4083-9f74-ea172018a0ee service placement] RBAC: Authorization granted {{(pid=81522) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 07:45:13.927690 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: [pid: 81522|app: 0|req: 1458/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Aug 17 07:45:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 07:45:23.923556 dv-cinder-853126-2-iscsi devstack@keystone.service[81522]: DEBUG dbcounter [-] [81522] Writing DB stats keystone:SELECT=89 {{(pid=81522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}